-- Logs begin at Fri 2022-05-27 02:22:04 UTC, end at Fri 2022-05-27 04:00:10 UTC. -- May 27 03:25:48.804976 dv-cinder-828805-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:25:48.814154 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:25:48 2022] *** May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: nodename: dv-cinder-828805-4-iscsi May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: machine: x86_64 May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: clock source: unix May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: pcre jit disabled May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: detected number of CPU cores: 4 May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: current working directory: / May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: detected binary path: /usr/bin/uwsgi-core May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: your processes number limit is 47680 May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: your memory page size is 4096 bytes May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: detected max file descriptor number: 2048 May 27 03:25:48.816197 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: lock engine: pthread robust mutexes May 27 03:25:48.817145 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: thunder lock: enabled May 27 03:25:48.817145 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:25:48.817145 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:25:48.860567 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: Python main interpreter initialized at 0x564ce50ba9c0 May 27 03:25:48.860567 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: python threads support enabled May 27 03:25:48.860567 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: your server socket listen backlog is limited to 100 connections May 27 03:25:48.860567 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: your mercy for graceful operations on workers is 90 seconds May 27 03:25:48.860894 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:25:48.860982 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: *** Operational MODE: preforking *** May 27 03:25:48.861216 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: *** uWSGI is running in multiple interpreter mode *** May 27 03:25:48.861216 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: spawned uWSGI master process (pid: 103870) May 27 03:25:48.861396 dv-cinder-828805-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:25:48.861936 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: spawned uWSGI worker 1 (pid: 103871, cores: 1) May 27 03:25:48.862263 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: spawned uWSGI worker 2 (pid: 103872, cores: 1) May 27 03:25:48.862434 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:25:50.029303 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:25:50.032882 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:25:50.750245 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:25:50.750245 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: from cryptography.utils import int_from_bytes May 27 03:25:50.750759 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:25:50.750759 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: from cryptography.utils import int_from_bytes May 27 03:25:50.751344 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:25:50.751344 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: from cryptography.utils import int_from_bytes May 27 03:25:50.751680 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:25:50.751680 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: from cryptography.utils import int_from_bytes May 27 03:25:53.401715 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:25:53.402238 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:25:53.402387 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:25:53.402743 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:25:53.403025 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:25:53.403407 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.403510 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:25:53.403868 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:25:53.403949 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.404040 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.404200 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:25:53.404334 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.404561 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:25:53.404669 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.404824 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:25:53.404950 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.405209 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.405296 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.405539 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.405624 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.405866 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.405951 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.406121 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.406206 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.406429 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.406523 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.406747 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-4-iscsi {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.406868 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.407094 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.407192 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.407396 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.407481 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.407699 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.407798 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408008 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408100 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408306 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408408 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408622 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408730 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-4-iscsi {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.408919 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.409006 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.409242 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.409402 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.409558 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.409848 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.409991 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.410146 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.410250 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.410461 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.410569 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.410777 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.410975 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.411138 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.411319 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.411462 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.411615 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.411763 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.411914 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.412065 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.412229 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.412386 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.412570 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.412691 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.412908 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.413039 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-4-iscsi {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.413185 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.413300 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.413502 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.413642 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.413818 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414077 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414196 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414340 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414465 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414625 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414826 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-4-iscsi {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.414996 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.415173 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.415444 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.416077 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.416219 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.416342 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.416538 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.416669 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.416960 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417272 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417401 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417584 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417680 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417882 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.417976 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.418187 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.418282 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.418490 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.418585 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.418803 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.418932 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419129 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419215 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419429 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419569 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419702 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419840 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.419972 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.420097 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.420267 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.420399 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.420586 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.420714 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.420902 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421033 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421169 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421367 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421643 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421768 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.421901 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422025 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422148 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422270 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422392 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422556 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422693 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.422876 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423043 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423176 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423300 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423472 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423611 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423771 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.423899 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424072 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424214 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424376 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424506 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424847 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.424998 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.425135 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.425312 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.425441 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.425613 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.425743 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.425925 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.426065 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.426232 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.426359 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.426541 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.426670 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.426873 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427017 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427189 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427316 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427500 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427625 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427802 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.427939 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.428112 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.428240 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.428427 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.428562 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.428800 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.428948 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429083 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429208 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429337 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429461 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429620 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429749 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.429936 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430072 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430233 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430368 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430505 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430630 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430753 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.430899 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.431108 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.431246 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.431422 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.431552 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.431725 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.431862 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432027 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432155 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432329 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432465 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432623 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432765 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.432925 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433062 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433228 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433362 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433529 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433665 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433830 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.433967 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.434132 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.434266 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.434432 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.434559 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.434732 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.434938 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435075 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435199 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435329 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435460 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435638 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435781 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.435952 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436085 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436250 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436376 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436551 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436691 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436850 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.436985 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.437151 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.437280 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.437453 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.437588 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.437753 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.437878 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.438053 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.438180 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.438367 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.438495 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.438668 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.438804 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439019 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439147 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439354 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439490 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439615 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439737 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439859 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.439982 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.440164 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.440300 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.440464 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.440591 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.440766 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.440903 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441074 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441196 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441376 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441511 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441676 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441804 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.441973 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.442108 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.442270 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.442407 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.442566 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.442694 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.442887 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443019 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443186 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443324 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443482 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443610 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443775 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.443903 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.444087 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.444222 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.444403 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.444540 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.444705 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.444838 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445006 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445133 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445305 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445441 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445606 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445733 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.445909 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.446036 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.446229 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.446371 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.446575 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.446704 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.446893 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.447020 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.447216 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.447358 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.447525 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.447654 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.447836 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.447963 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:25:53.448144 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.448286 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.448455 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.448583 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.448776 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.448917 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449068 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449268 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449396 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449532 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449670 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449810 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.449984 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.450113 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.450299 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.450425 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.450628 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.450763 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.450961 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.451103 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.451274 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.451400 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.451588 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.451730 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.451876 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452008 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452193 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452324 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452515 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452651 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452831 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.452960 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.453137 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.453264 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.453466 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.453601 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.454043 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.454185 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.454347 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.454473 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.454668 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.454791 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455011 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455112 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455317 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455418 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455622 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455725 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.455928 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456028 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456247 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456345 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456572 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456661 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456880 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.456974 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.457192 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.457286 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.457500 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.457588 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.457805 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.457892 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.458110 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.458211 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.458415 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.458510 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.458719 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.458806 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.459071 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.459158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.459380 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.459476 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.459692 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.459858 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460008 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460159 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460310 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460462 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460609 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460749 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.460895 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.461114 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.461258 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.461399 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.461565 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.461706 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.461853 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.462010 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.462152 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.462787 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.462968 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.463107 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.463246 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.463398 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.463538 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.463676 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.463859 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464007 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464152 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464300 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464465 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464609 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464759 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.464897 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465044 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465184 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465345 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465500 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465641 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465780 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.465945 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466087 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466225 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466364 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466510 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466662 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466814 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.466991 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467132 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467271 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467410 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467549 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467697 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467837 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.467983 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.468123 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.468285 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.468439 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.468589 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.468731 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.468870 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469016 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469156 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469304 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469529 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469676 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469815 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.469954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.470103 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.470258 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.470404 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.470560 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.470699 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.470871 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471018 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471173 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471314 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471453 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471598 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471737 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.471885 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472025 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472163 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472312 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472452 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472738 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.472879 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473018 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473156 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473323 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473469 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473621 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473802 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.473949 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.474110 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.474266 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.474435 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.474592 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.474758 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.474936 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475087 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475226 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475374 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475515 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475654 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475793 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.475938 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476082 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476240 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476382 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476520 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476659 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476798 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.476936 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.477083 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.477224 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.477363 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.477501 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.477680 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.477867 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.478550 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.478711 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.478885 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479031 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479182 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479331 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479473 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479696 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479850 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.479991 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.480130 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.480283 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.480432 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.480587 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.480737 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.480884 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481030 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481179 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481327 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481467 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481606 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481748 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.481887 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482039 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482178 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482325 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482482 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482635 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482784 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.482957 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483098 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483238 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483377 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483515 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483694 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483850 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.483990 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.484129 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.484275 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.484425 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.484602 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.484749 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.484930 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485077 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485244 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485398 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485547 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485694 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485833 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.485980 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.486140 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.486289 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.486448 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.486589 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.486728 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.486891 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487036 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487192 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487332 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487472 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487619 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487759 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.487924 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488079 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488220 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488370 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488510 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488681 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488835 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.488984 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.489130 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.489294 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.489440 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.489607 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.489845 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.490068 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.490219 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.490359 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.490509 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.490650 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.490809 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491093 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491235 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491373 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491511 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491649 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491798 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.491937 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492075 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492213 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492362 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492501 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492648 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492648 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.492912 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.493296 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.493485 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.493633 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.493787 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.493930 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494077 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494228 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494368 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494527 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494676 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494815 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.494983 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495124 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495274 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495427 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495567 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495706 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495844 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.495983 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.496129 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.496281 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.496448 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.496588 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.496727 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.496864 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497003 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497152 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497291 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497437 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497577 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497722 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.497874 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498024 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498165 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498314 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498460 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498599 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498746 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.498924 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.499071 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.499209 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.499347 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.499485 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.499636 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.499776 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500001 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500148 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500297 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500436 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500583 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500731 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.500870 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501008 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501148 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501292 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501440 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501580 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501718 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.501857 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502005 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502153 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502294 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502432 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502587 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502726 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.502884 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503041 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503188 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503329 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503481 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503621 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503759 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.503917 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504064 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504204 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504343 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504482 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504620 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504768 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.504907 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505046 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505046 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505316 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505464 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505603 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505752 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.505892 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506031 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506178 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506326 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506472 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506613 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506752 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.506912 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507207 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507354 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507503 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507642 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507788 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.507927 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.508075 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.508252 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.508399 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.508574 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.508720 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.508909 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.509086 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.509248 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.509525 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.509681 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.509822 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.509960 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.510195 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.510341 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.510480 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.510620 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.510759 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.510952 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511112 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511253 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511391 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511530 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511680 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511819 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.511969 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.512139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.512292 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.512443 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.512679 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.512826 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.513011 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.513232 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.513375 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.513599 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.513793 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.513950 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.514194 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.514347 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.514494 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.514657 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.514804 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515005 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515163 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515313 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515453 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515624 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515772 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.515923 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.516072 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.516236 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.516382 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.516609 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.516760 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.516943 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.517149 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.517296 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.517467 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.517614 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.517792 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.517946 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.518106 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.518359 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.518499 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.518637 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.518775 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.518959 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.519111 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.519279 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.519423 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.519569 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.519859 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.520014 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.520172 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.520447 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.520611 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.520801 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.520922 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.521106 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.521314 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.521403 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.521691 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.521957 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.522109 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.522285 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.522527 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.522682 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.522922 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.523197 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.523358 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.523499 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.523781 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.523926 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.524065 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.524205 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.524354 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.524501 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.524648 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.525346 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.525498 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.525638 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.525790 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.525938 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.526078 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.526217 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.526365 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.526608 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.526763 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.526934 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.527627 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.527782 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.527924 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528086 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528235 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528235 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528516 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528657 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528657 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.528928 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.529078 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.529226 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.529374 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.529515 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.529654 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.529811 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.530017 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.530206 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.530377 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.530627 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.530778 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.530970 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.531264 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.531409 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.531557 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.531868 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.532021 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.532310 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.532511 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.532888 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.533035 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.533233 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.533503 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.533652 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.533906 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.534051 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.534220 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.534367 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.534515 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.535155 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.535318 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.535498 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.535648 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.535795 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.535947 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536098 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536246 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536386 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536540 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536540 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536835 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.536982 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.537127 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.537271 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.537436 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.537592 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.537738 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.537884 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538029 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538172 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538316 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538469 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538615 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538759 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.538942 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.539090 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.539243 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.539443 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.539603 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.539751 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.540048 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.540208 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.540933 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.541115 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.541264 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.541539 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.541693 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.541861 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.542133 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.542287 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.542455 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.542714 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.542898 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.543082 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.543346 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.543508 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.543696 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.543902 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.544076 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.544229 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.544384 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.544531 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.544677 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.544847 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545035 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545197 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545354 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545500 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545658 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545809 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.545961 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.546120 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.546268 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.546420 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.546566 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.546729 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.546935 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.547173 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.547324 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.547470 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.547616 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.547762 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.547907 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548066 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548213 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548359 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548504 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548650 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548806 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.548961 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549108 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549253 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549399 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549545 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549698 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549844 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.549989 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.550150 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.550297 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.550443 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.550596 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.550756 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.550930 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551080 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551225 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551370 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551526 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551681 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551834 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.551986 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.552133 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.552279 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.552432 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.552579 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.552734 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.552879 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553024 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553177 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553323 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553468 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553613 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553764 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.553909 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.554063 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.554207 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.554361 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.554517 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.554683 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.554975 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.555142 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.555289 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.555435 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.555578 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.555734 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.555880 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.556035 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.556181 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.556392 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.556542 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.556708 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.556863 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557011 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557156 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557301 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557446 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557743 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.557743 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558029 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558173 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558319 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558319 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558616 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558764 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.558939 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559087 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559232 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559376 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559532 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559680 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559825 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.559970 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.560115 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.560268 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.560424 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.560578 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.560724 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.560878 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561025 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561180 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561336 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561437 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561541 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561680 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561835 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.561996 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.562149 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.562306 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.562453 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.562605 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.562758 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563029 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563188 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563334 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563477 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563622 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563777 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.563923 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564069 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564214 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564370 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564522 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564680 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564827 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.564969 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.565141 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.565294 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.565439 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.565593 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.565759 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.565924 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.566075 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.566222 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.566384 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.566531 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.566685 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.566898 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567068 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567216 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567369 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567513 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567658 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567811 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.567958 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.568102 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.568258 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.568411 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.568566 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.568713 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.568859 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569003 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569148 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569294 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569447 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569593 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569738 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.569882 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570034 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570189 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570343 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570490 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570635 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570780 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.570951 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.571098 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.571255 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.571409 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.571556 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.571738 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.571891 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572046 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572201 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572346 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572501 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572654 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572798 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.572952 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.573098 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.573251 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.573398 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.573550 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.573696 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.573850 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574003 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574160 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574306 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574457 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574603 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574757 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.574951 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.575100 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.575247 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.575391 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.575549 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.575696 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.575850 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576016 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576171 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576325 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576479 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576627 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576771 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.576916 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577062 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577215 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577370 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577523 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577670 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577815 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.577975 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.578129 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.578283 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.578430 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.578575 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.578997 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.579155 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.579321 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.579468 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.579613 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.579759 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.579912 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580059 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580227 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580375 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580520 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580665 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580809 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.580954 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581108 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581254 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581399 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581544 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581689 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581834 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.581994 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.582151 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.582297 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.582442 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.582587 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.582741 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.582929 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583083 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583236 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583383 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583528 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583682 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583828 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.583984 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.584130 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.584283 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.584430 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.584584 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.584730 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.584875 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585020 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585166 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585311 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585501 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585649 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585794 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.585967 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.586117 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.586270 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.586424 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.586570 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.586723 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.586892 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.587055 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.587705 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.587854 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588000 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588144 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588299 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588456 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588609 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588757 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.588902 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589047 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589191 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589337 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589490 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589637 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589781 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.589934 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.590080 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.590247 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.590395 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.590541 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.590693 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.590893 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591046 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591205 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591359 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591506 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591652 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591797 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.591942 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.592096 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.592253 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.592400 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.592545 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.592698 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.592920 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593076 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593230 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593376 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593522 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593668 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593821 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.593975 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.594140 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.594288 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.594433 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.594591 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.594745 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.594916 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595068 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595216 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595370 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595527 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595673 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595818 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.595996 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.596153 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.596299 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.596457 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.596612 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.596759 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.596910 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597064 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597210 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597364 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597510 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597656 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597801 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.597801 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.598089 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.598244 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.598391 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.598536 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.598682 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.598828 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599019 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599174 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599321 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599466 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599611 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599767 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.599990 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.600138 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.600290 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.600443 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.600590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.600737 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.600891 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601044 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601191 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601336 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601482 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601794 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.601949 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.602095 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.602242 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.602387 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.602543 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.602707 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.603428 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.603585 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.603731 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.603877 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604041 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604199 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604345 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604490 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604647 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604802 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.604950 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.605095 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.605240 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.605385 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.605530 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.605683 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.605831 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.606004 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.606159 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.606306 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.606481 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.606645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.606824 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607014 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607171 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607325 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607479 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607626 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607773 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.607917 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608074 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608219 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608373 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608520 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608666 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608811 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.608956 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.609101 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.609264 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.609411 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.609557 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.609703 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.609858 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.610018 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.610172 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.610318 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.610464 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.610653 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.610804 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611009 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611305 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611451 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611597 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611743 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.611906 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612052 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612206 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612354 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612499 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612657 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612813 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.612967 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.613120 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.613274 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.613429 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.613584 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.613730 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.613885 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614038 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614185 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614330 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614488 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614644 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614791 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.614947 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615044 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615130 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615292 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615385 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615595 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615684 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615903 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.615992 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.616202 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.616438 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.616539 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.616794 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.616892 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.617117 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.617207 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.617427 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.617522 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.617724 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.617811 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.618036 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.618126 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.618341 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.618429 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.618682 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.618772 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619011 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619102 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619323 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619409 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619640 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619727 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.619956 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.620045 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.620264 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.620480 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.620577 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.620809 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.620899 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.621126 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.621214 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.621455 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.621541 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.621778 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.621873 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.622072 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.622160 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.622373 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.622471 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.622674 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.622778 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623013 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623110 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623318 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623412 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623624 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623714 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.623929 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624017 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624233 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624325 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624538 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624626 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624838 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.624934 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.625141 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.625239 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.625444 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.625531 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.625748 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.625834 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626049 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626144 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626354 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626448 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626658 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626745 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.626981 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.627072 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.627292 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.627378 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.627625 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.627713 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.627941 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628030 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628245 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628332 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628554 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628641 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628865 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.628954 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.629171 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.629264 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.629476 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.629564 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.629781 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.629876 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.630085 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.630179 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.630395 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.630494 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.630717 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.630968 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.631073 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.631307 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.631396 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.631632 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.631733 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.631970 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.632058 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.632304 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.632406 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.632616 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.632716 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.632923 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633019 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633233 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633330 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633547 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633634 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633856 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.633942 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.634694 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.634803 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635024 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635126 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635337 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635424 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635652 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635749 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.635965 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636060 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636277 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636364 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636576 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636664 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636878 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.636973 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.637178 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.637274 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.637485 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.637575 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.637794 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.637880 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.638098 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.638185 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.638399 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.638487 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.638697 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.638790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639113 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639324 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639414 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639625 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639711 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.639924 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640020 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640223 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640310 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640525 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640612 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640821 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.640916 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.641119 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.641213 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.641415 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.641509 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.641713 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.641813 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642011 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642099 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642313 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642400 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642681 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642806 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.642923 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.643149 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.643234 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.643472 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.643571 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.643790 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.643877 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.644089 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.644177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.644411 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.644506 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.644740 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.644845 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645048 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645136 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645365 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645467 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645671 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645759 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.645987 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.646074 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.646291 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.646379 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.646605 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.646691 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.646947 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647077 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647259 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647356 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647564 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647653 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647870 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.647958 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.648179 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.648273 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.648486 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.648573 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.648793 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.648889 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.649096 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.649183 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.649398 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.649483 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.650353 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.650554 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.650643 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.650883 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.650972 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.651193 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.651292 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.651500 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.651595 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.651858 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.651953 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.652117 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.652214 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.652423 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.652510 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.652736 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.652822 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653032 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653121 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653338 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653425 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653640 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653726 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.653947 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.654041 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.654252 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.654338 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.654558 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.654645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.654884 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655006 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655191 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655295 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655495 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655593 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655819 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.655905 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.656128 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.656223 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.656471 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.656577 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.656764 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.656859 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.657075 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.657168 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.657399 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.657495 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.657710 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.657799 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658032 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658119 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658343 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658514 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658651 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658740 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.658977 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.659067 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.659221 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:25:53.659311 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.659606 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.659921 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.660236 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.660548 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.660862 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.661174 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.661505 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.661833 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.662141 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.662465 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.662784 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.663138 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.663457 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.663773 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.664103 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.664416 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.664733 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.665054 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.665390 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.665704 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.666022 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.666342 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.666675 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.667029 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.667345 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.667674 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.668003 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.668353 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.668672 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.669019 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.669349 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.669666 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.669982 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.670290 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:25:53.670535 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:25:53.717959 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO dbcounter [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Registered counter for database nova_api May 27 03:25:53.730194 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO dbcounter [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Registered counter for database nova_api May 27 03:25:53.738524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_db.sqlalchemy.engines [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.745041 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writer thread running {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:53.750647 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_db.sqlalchemy.engines [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.757163 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writer thread running {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:53.802352 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.context [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e92bf5b-a7a5-461c-810d-6697c81d065e(cell1) {{(pid=103872) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:25:53.806461 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.808077 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.808892 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.810860 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.812923 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO dbcounter [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Registered counter for database nova_cell0 May 27 03:25:53.814148 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.context [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e92bf5b-a7a5-461c-810d-6697c81d065e(cell1) {{(pid=103871) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:25:53.817061 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO dbcounter [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Registered counter for database nova_cell1 May 27 03:25:53.818435 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_concurrency.lockutils [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.820136 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_concurrency.lockutils [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.820936 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_concurrency.lockutils [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.823511 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_concurrency.lockutils [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.825404 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_db.sqlalchemy.engines [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.825589 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO dbcounter [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Registered counter for database nova_cell0 May 27 03:25:53.827957 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_db.sqlalchemy.engines [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.829988 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO dbcounter [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Registered counter for database nova_cell1 May 27 03:25:53.833079 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writer thread running {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:53.835507 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writer thread running {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:53.837125 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_db.sqlalchemy.engines [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.839492 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_db.sqlalchemy.engines [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.845409 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writer thread running {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:53.847031 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writer thread running {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:53.980704 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO dbcounter [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Registered counter for database nova_cell0 May 27 03:25:53.989273 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_db.sqlalchemy.engines [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:53.992531 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO dbcounter [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Registered counter for database nova_cell0 May 27 03:25:53.994246 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writer thread running {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:54.001670 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG oslo_db.sqlalchemy.engines [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:25:54.006006 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writer thread running {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:25:54.440952 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: WARNING keystonemiddleware.auth_token [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:25:54.448180 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: WARNING keystonemiddleware.auth_token [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:25:54.467811 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: WARNING keystonemiddleware.auth_token [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:25:54.475250 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: WARNING keystonemiddleware.auth_token [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:25:54.789103 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: WARNING keystonemiddleware.auth_token [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:25:54.795091 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: WARNING keystonemiddleware.auth_token [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:25:54.800330 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ce50ba9c0 pid: 103872 (default app) May 27 03:25:54.802400 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.803614 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 May 27 03:25:54.804039 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:54.816118 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: WARNING keystonemiddleware.auth_token [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:25:54.822714 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: WARNING keystonemiddleware.auth_token [None req-a84ea247-a9d3-448f-b40c-0e9b088b982c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:25:54.827995 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ce50ba9c0 pid: 103871 (default app) May 27 03:27:15.789312 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:15.790321 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 27 03:27:15.790712 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:15.802395 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writing DB stats nova_api:SELECT=3 {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:15.803543 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writing DB stats nova_cell0:SELECT=3 {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:15.804382 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writing DB stats nova_cell1:SELECT=3 {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:15.805190 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:16.238556 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-846c8bd5-ff3b-401b-bdbe-9bcd6a34fc97 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:16.268565 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-846c8bd5-ff3b-401b-bdbe-9bcd6a34fc97 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471268 May 27 03:27:16.283073 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 27 03:27:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:18.569671 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:18.570693 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-161ff98f-7d0a-43dd-b19c-decaa2e2c355 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 27 03:27:18.571184 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:18.630754 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-c74464d7-ddfc-41c3-90a8-48dff5ce0f53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "ram": 256, "vcpus": 1, "id": "c1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:18.650127 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:27:18.650127 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: warnings.warn(msg) May 27 03:27:18.735768 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-c74464d7-ddfc-41c3-90a8-48dff5ce0f53 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.158684 May 27 03:27:18.736510 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:18.749471 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_api:SELECT=3 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:18.750262 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_cell1:SELECT=3 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:18.751454 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_cell0:SELECT=3 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:18.752191 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:18.958679 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-7063f05f-dd9a-4b63-982d-c7ec0bbe2894 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:18.963029 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:27:18.963029 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: warnings.warn(msg) May 27 03:27:19.106386 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-7063f05f-dd9a-4b63-982d-c7ec0bbe2894 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361943 May 27 03:27:19.111396 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 27 03:27:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:21.362476 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-c74464d7-ddfc-41c3-90a8-48dff5ce0f53 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:21.363486 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-c74464d7-ddfc-41c3-90a8-48dff5ce0f53 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 27 03:27:21.363890 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:21.469328 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-5ec63812-fc96-44df-84b7-ac0c991cef9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:21.487225 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:27:21.487225 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: warnings.warn(msg) May 27 03:27:21.561152 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-5ec63812-fc96-44df-84b7-ac0c991cef9e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.190953 May 27 03:27:21.561721 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:27:21.573330 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-05986a3e-1bea-4394-aeb2-8dcec7157a7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:21.574878 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:27:21.574878 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: warnings.warn(msg) May 27 03:27:21.675205 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-05986a3e-1bea-4394-aeb2-8dcec7157a7b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105287 May 27 03:27:21.675805 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 27 03:27:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:23.943952 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-5ec63812-fc96-44df-84b7-ac0c991cef9e admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:23.945512 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-5ec63812-fc96-44df-84b7-ac0c991cef9e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 27 03:27:23.946074 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:24.024899 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-934929a8-f900-4704-a6c3-0df78fdb489d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:24.127288 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-934929a8-f900-4704-a6c3-0df78fdb489d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.175350 May 27 03:27:24.130896 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:24.140719 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-1a03fbd5-a2f1-4bab-a18c-566553c3ad89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:24.227448 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-1a03fbd5-a2f1-4bab-a18c-566553c3ad89 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090257 May 27 03:27:24.228137 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 27 03:27:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:26.519153 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-934929a8-f900-4704-a6c3-0df78fdb489d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:26.520188 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-934929a8-f900-4704-a6c3-0df78fdb489d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 27 03:27:26.520598 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:26.582578 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-5b7b6ddd-e15c-440b-bf70-c19e2c4635dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:26.657651 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-5b7b6ddd-e15c-440b-bf70-c19e2c4635dd admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130527 May 27 03:27:26.658210 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:26.669941 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-07fb8d73-b748-4235-ab6f-b401055566ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:26.769862 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-07fb8d73-b748-4235-ab6f-b401055566ae admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103510 May 27 03:27:26.770456 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 27 03:27:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:29.030277 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-5b7b6ddd-e15c-440b-bf70-c19e2c4635dd admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:29.031314 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-5b7b6ddd-e15c-440b-bf70-c19e2c4635dd admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 27 03:27:29.031710 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:29.093475 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-da7b80ae-e62c-4dc4-81d3-2f637b3f5f30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "disk": 20}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:29.172897 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-da7b80ae-e62c-4dc4-81d3-2f637b3f5f30 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135527 May 27 03:27:29.173723 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:29.186318 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-b5457c9a-4052-45b2-ba1b-5b946f378c8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:29.313021 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-b5457c9a-4052-45b2-ba1b-5b946f378c8d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130606 May 27 03:27:29.317168 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 27 03:27:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:31.608228 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-da7b80ae-e62c-4dc4-81d3-2f637b3f5f30 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:31.609250 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-da7b80ae-e62c-4dc4-81d3-2f637b3f5f30 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 27 03:27:31.609653 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:31.667987 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-4ebd0dd8-b0a3-467c-ace6-22d9bf49f8c2 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:31.691477 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-4ebd0dd8-b0a3-467c-ace6-22d9bf49f8c2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075591 May 27 03:27:31.692139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 27 03:27:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:33.979982 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-da7b80ae-e62c-4dc4-81d3-2f637b3f5f30 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:33.980994 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-da7b80ae-e62c-4dc4-81d3-2f637b3f5f30 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 27 03:27:33.981420 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:34.042417 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-0fd46802-f915-431d-a340-28d20ba9b87e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:34.144103 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-0fd46802-f915-431d-a340-28d20ba9b87e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.156342 May 27 03:27:34.145264 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:27:34.170432 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ea5019c3-fe4f-42c4-904b-6d8b464ca387 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:34.267370 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ea5019c3-fe4f-42c4-904b-6d8b464ca387 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101322 May 27 03:27:34.267955 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 27 03:27:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:36.638954 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-0fd46802-f915-431d-a340-28d20ba9b87e admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:36.640018 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-0fd46802-f915-431d-a340-28d20ba9b87e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 May 27 03:27:36.640432 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:36.701914 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-572749d1-3d7f-4692-b386-f06a3674e9dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:36.785099 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-572749d1-3d7f-4692-b386-f06a3674e9dc admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.138529 May 27 03:27:36.785862 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:36.798578 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-47332f92-fe90-4a42-a40c-7d04b5c6c163 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:36.861535 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-47332f92-fe90-4a42-a40c-7d04b5c6c163 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066654 May 27 03:27:36.862056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 27 03:27:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:39.119661 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-572749d1-3d7f-4692-b386-f06a3674e9dc admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:39.120851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-572749d1-3d7f-4692-b386-f06a3674e9dc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 May 27 03:27:39.121333 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:39.178094 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-cc5bd029-b693-4e78-8e1b-71be0a907b8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "vcpus": 2, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:39.279704 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-cc5bd029-b693-4e78-8e1b-71be0a907b8f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.152441 May 27 03:27:39.280255 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:27:39.293039 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-afae9c0c-2881-4aa0-8355-8aa0cc082987 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:39.408953 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-afae9c0c-2881-4aa0-8355-8aa0cc082987 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119638 May 27 03:27:39.409471 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 27 03:27:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:41.646351 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-cc5bd029-b693-4e78-8e1b-71be0a907b8f admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:41.647422 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-cc5bd029-b693-4e78-8e1b-71be0a907b8f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 27 03:27:41.647825 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:41.704812 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-1fd43af1-11ab-46da-8fc8-95093a740ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "vcpus": 4}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:41.799823 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-1fd43af1-11ab-46da-8fc8-95093a740ecc admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146151 May 27 03:27:41.800417 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:27:41.813205 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-413b0ecf-ee44-447c-81e6-9195d1b3230e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:41.930027 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-413b0ecf-ee44-447c-81e6-9195d1b3230e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120505 May 27 03:27:41.930612 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 27 03:27:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:44.226507 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-1fd43af1-11ab-46da-8fc8-95093a740ecc admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:44.228206 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-1fd43af1-11ab-46da-8fc8-95093a740ecc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 May 27 03:27:44.228844 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:44.294110 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-9267ac76-e295-4b0a-847a-ccf822f3a77d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:44.549390 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-9267ac76-e295-4b0a-847a-ccf822f3a77d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.314480 May 27 03:27:44.550274 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 27 03:27:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:44.562870 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-9f97f988-c063-454a-ad04-6b078c639713 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:44.673314 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-9f97f988-c063-454a-ad04-6b078c639713 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114120 May 27 03:27:44.673945 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 27 03:27:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:09.252752 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-9267ac76-e295-4b0a-847a-ccf822f3a77d admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.253760 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-9267ac76-e295-4b0a-847a-ccf822f3a77d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 27 03:28:09.254192 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:09.264596 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:09.311330 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-c5addd21-ae6a-4806-a1c6-0395c8cb0a42 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.329051 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-c5addd21-ae6a-4806-a1c6-0395c8cb0a42 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068903 May 27 03:28:09.329521 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:10.304628 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-9267ac76-e295-4b0a-847a-ccf822f3a77d admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.305663 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-9267ac76-e295-4b0a-847a-ccf822f3a77d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 27 03:28:10.306088 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:10.517729 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-bbef9fa3-f698-449a-9121-e51f30396c4b admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.523808 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.wsgi [None req-bbef9fa3-f698-449a-9121-e51f30396c4b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-bbef9fa3-f698-449a-9121-e51f30396c4b admin admin] Request method failure captured: May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Accept: application/json May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Accept-Encoding: gzip, deflate May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Connection: keep-alive May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Content-Length: 0 May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Host: 10.222.0.24 May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Openstack-Api-Version: compute 2.90 May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Openstack-System-Scope: None May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: User-Agent: python-novaclient May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Auth-Token: gAAAAABikEVKCQBdfZWY-_mlXZmGTwNcn9qrYgu-7QSiRAueKrfILpEKuyZtBx6XbCQ9sUWLeWadn_kRUxP4wH4p-ib_jNJjXJ8XcGwS0zSCDi49ZiQDmiyOTAFOqtsL5qRdKfTNSBkT_g_-QYvX6ynffneVDnp2fbrShPL6C2PQFVEKIAuB88E May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Domain-Id: None May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Domain-Name: None May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Identity-Status: Confirmed May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Is-Admin-Project: True May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Domain-Id: default May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Domain-Name: Default May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Name: admin May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Role: member,admin,reader May 27 03:28:10.527131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Roles: member,admin,reader May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d3e8df9c2aa4b4588906f73830bd805", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d3e8df9c2aa4b4588906f73830bd805"}]}] May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant: admin May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant-Name: admin May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User: admin May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Domain-Id: default May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Domain-Name: Default May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Id: 93ab1998e69940199adfdba4433a4d08 May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Name: admin May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: method: > May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: exception: Flavor 42 could not be found. May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: action_args: {'id': '42'} May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:10.528769 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:10.529851 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:10.531320 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-bbef9fa3-f698-449a-9121-e51f30396c4b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:10.532779 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-bbef9fa3-f698-449a-9121-e51f30396c4b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070248 May 27 03:28:10.532779 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:28:10.539124 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-753b4081-edae-4e8e-be7c-5611221a033e admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.542046 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:10.560892 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-753b4081-edae-4e8e-be7c-5611221a033e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025892 May 27 03:28:10.561427 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:10.570937 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-f7b5dfeb-3c1c-4754-b56e-10c289f91814 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.592262 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-f7b5dfeb-3c1c-4754-b56e-10c289f91814 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024845 May 27 03:28:10.592793 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:10.602619 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-de3b6eec-b510-43ec-9d77-f7d14f229b45 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.608282 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.wsgi [None req-de3b6eec-b510-43ec-9d77-f7d14f229b45 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-de3b6eec-b510-43ec-9d77-f7d14f229b45 admin admin] Request method failure captured: May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Accept: application/json May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Accept-Encoding: gzip, deflate May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Connection: keep-alive May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Content-Length: 0 May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Host: 10.222.0.24 May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Openstack-Api-Version: compute 2.90 May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Openstack-System-Scope: None May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: User-Agent: python-novaclient May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Auth-Token: gAAAAABikEVKCQBdfZWY-_mlXZmGTwNcn9qrYgu-7QSiRAueKrfILpEKuyZtBx6XbCQ9sUWLeWadn_kRUxP4wH4p-ib_jNJjXJ8XcGwS0zSCDi49ZiQDmiyOTAFOqtsL5qRdKfTNSBkT_g_-QYvX6ynffneVDnp2fbrShPL6C2PQFVEKIAuB88E May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Domain-Id: None May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Domain-Name: None May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Identity-Status: Confirmed May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Is-Admin-Project: True May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Domain-Id: default May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Domain-Name: Default May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Name: admin May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Role: member,admin,reader May 27 03:28:10.611503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Roles: member,admin,reader May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d3e8df9c2aa4b4588906f73830bd805", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d3e8df9c2aa4b4588906f73830bd805"}]}] May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant: admin May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant-Name: admin May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User: admin May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Domain-Id: default May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Domain-Name: Default May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Id: 93ab1998e69940199adfdba4433a4d08 May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Name: admin May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: method: > May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: exception: Flavor 42 could not be found. May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: action_args: {'id': '42'} May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:10.613092 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:10.614056 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:10.620460 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-de3b6eec-b510-43ec-9d77-f7d14f229b45 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:10.621722 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-de3b6eec-b510-43ec-9d77-f7d14f229b45 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014620 May 27 03:28:10.621722 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 27 03:28:11.506323 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-f7b5dfeb-3c1c-4754-b56e-10c289f91814 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.507352 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-f7b5dfeb-3c1c-4754-b56e-10c289f91814 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001944 May 27 03:28:11.507746 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:11.692869 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-17dc5f23-2dfd-49d4-b593-a50e195283ea admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.698680 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.wsgi [None req-17dc5f23-2dfd-49d4-b593-a50e195283ea admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-17dc5f23-2dfd-49d4-b593-a50e195283ea admin admin] Request method failure captured: May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Accept: application/json May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Accept-Encoding: gzip, deflate May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Connection: keep-alive May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Content-Length: 0 May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Host: 10.222.0.24 May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Openstack-Api-Version: compute 2.90 May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Openstack-System-Scope: None May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: User-Agent: python-novaclient May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Auth-Token: gAAAAABikEVL-zWFlhN04lnEzLjcm--5_b6YHHl2HP7imOW08NSfQBd4DlqmFyqCrZKXBkV3su8okftj3gaRPnPpMCG8dTuvfjwpMlnZpDMtaO3z6dT8HTy5Mu0vXhODW36RNI4AGq6XHwzkrquthHizUPBQHS1yUcNML9UvIK3yMplxVvQXJ8s May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Domain-Id: None May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Domain-Name: None May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Identity-Status: Confirmed May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Is-Admin-Project: True May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Domain-Id: default May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Domain-Name: Default May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Name: admin May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Role: member,admin,reader May 27 03:28:11.700170 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Roles: member,admin,reader May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d3e8df9c2aa4b4588906f73830bd805", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d3e8df9c2aa4b4588906f73830bd805"}]}] May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant: admin May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant-Name: admin May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User: admin May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Domain-Id: default May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Domain-Name: Default May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Id: 93ab1998e69940199adfdba4433a4d08 May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Name: admin May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: method: > May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: exception: Flavor 84 could not be found. May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: action_args: {'id': '84'} May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:11.701732 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:11.703139 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:11.704524 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-17dc5f23-2dfd-49d4-b593-a50e195283ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:11.705851 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-17dc5f23-2dfd-49d4-b593-a50e195283ea admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059546 May 27 03:28:11.705851 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:28:11.711536 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-0149b2ad-fad9-43ad-82b4-5efdd844c15c admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.726661 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-0149b2ad-fad9-43ad-82b4-5efdd844c15c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018772 May 27 03:28:11.727228 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:11.736946 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-e8a8bc57-625a-4956-86d8-a1cc6e9609b3 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.750920 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-e8a8bc57-625a-4956-86d8-a1cc6e9609b3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017784 May 27 03:28:11.751437 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:11.760868 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-3bf7e631-f682-4693-a76c-54ce7eea79ab admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.766046 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.wsgi [None req-3bf7e631-f682-4693-a76c-54ce7eea79ab admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-3bf7e631-f682-4693-a76c-54ce7eea79ab admin admin] Request method failure captured: May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Accept: application/json May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Accept-Encoding: gzip, deflate May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Connection: keep-alive May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Content-Length: 0 May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Host: 10.222.0.24 May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Openstack-Api-Version: compute 2.90 May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Openstack-System-Scope: None May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: User-Agent: python-novaclient May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Auth-Token: gAAAAABikEVL-zWFlhN04lnEzLjcm--5_b6YHHl2HP7imOW08NSfQBd4DlqmFyqCrZKXBkV3su8okftj3gaRPnPpMCG8dTuvfjwpMlnZpDMtaO3z6dT8HTy5Mu0vXhODW36RNI4AGq6XHwzkrquthHizUPBQHS1yUcNML9UvIK3yMplxVvQXJ8s May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Domain-Id: None May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Domain-Name: None May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Identity-Status: Confirmed May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Is-Admin-Project: True May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Domain-Id: default May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Domain-Name: Default May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Name: admin May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Role: member,admin,reader May 27 03:28:11.767590 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Roles: member,admin,reader May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d3e8df9c2aa4b4588906f73830bd805", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d3e8df9c2aa4b4588906f73830bd805"}]}] May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant: admin May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant-Name: admin May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User: admin May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Domain-Id: default May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Domain-Name: Default May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Id: 93ab1998e69940199adfdba4433a4d08 May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Name: admin May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: method: > May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: exception: Flavor 84 could not be found. May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: action_args: {'id': '84'} May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:11.768954 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:11.769728 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:11.770790 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-3bf7e631-f682-4693-a76c-54ce7eea79ab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:11.771910 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-3bf7e631-f682-4693-a76c-54ce7eea79ab admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011479 May 27 03:28:11.771910 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:28:12.625580 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-e8a8bc57-625a-4956-86d8-a1cc6e9609b3 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.626603 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-e8a8bc57-625a-4956-86d8-a1cc6e9609b3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 27 03:28:12.627036 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:12.813302 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-4c34f3a1-ebec-44c4-875e-fd27d34103a2 admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.819164 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.wsgi [None req-4c34f3a1-ebec-44c4-875e-fd27d34103a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-4c34f3a1-ebec-44c4-875e-fd27d34103a2 admin admin] Request method failure captured: May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Accept: application/json May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Accept-Encoding: gzip, deflate May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Connection: keep-alive May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Content-Length: 0 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Host: 10.222.0.24 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Openstack-Api-Version: compute 2.90 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Openstack-System-Scope: None May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: User-Agent: python-novaclient May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Auth-Token: gAAAAABikEVMNp_eSFXwXs3bd9liM_b87uvKMJihtRm8X2RglXyjxfpny2AIFCElnyJMHxb7Ms_uTw2Q-iOHH7gWL3px933g0smauzx9rrEO1AM_I-dfbMifVnsS8RsCNZkYDc5eOfXIQZyYKUrdmTnFY7LoW-0h1eNd7dD_ZBo2rUBQdPKmMj0 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Domain-Id: None May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Domain-Name: None May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Identity-Status: Confirmed May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Is-Admin-Project: True May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Domain-Id: default May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Domain-Name: Default May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Project-Name: admin May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Role: member,admin,reader May 27 03:28:12.820645 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Roles: member,admin,reader May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d3e8df9c2aa4b4588906f73830bd805", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d3e8df9c2aa4b4588906f73830bd805"}]}] May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant: admin May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-Tenant-Name: admin May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User: admin May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Domain-Id: default May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Domain-Name: Default May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Id: 93ab1998e69940199adfdba4433a4d08 May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: X-User-Name: admin May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: method: > May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: exception: Flavor 451 could not be found. May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: action_args: {'id': '451'} May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:12.822158 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:12.823177 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: ERROR nova.api.openstack.wsgi May 27 03:28:12.824281 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-4c34f3a1-ebec-44c4-875e-fd27d34103a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:12.825326 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-4c34f3a1-ebec-44c4-875e-fd27d34103a2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061107 May 27 03:28:12.825326 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:28:12.831958 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-52f51209-34a2-450c-bbd6-118576bf3cef admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.846380 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-52f51209-34a2-450c-bbd6-118576bf3cef admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018207 May 27 03:28:12.846854 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:12.856566 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.869519 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017082 May 27 03:28:12.870032 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:12.878856 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-371e1197-540d-43cf-a9f6-09d058af4f95 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.884540 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.wsgi [None req-371e1197-540d-43cf-a9f6-09d058af4f95 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-371e1197-540d-43cf-a9f6-09d058af4f95 admin admin] Request method failure captured: May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Accept: application/json May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Accept-Encoding: gzip, deflate May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Connection: keep-alive May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Content-Length: 0 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Host: 10.222.0.24 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Openstack-Api-Version: compute 2.90 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Openstack-System-Scope: None May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: User-Agent: python-novaclient May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Auth-Token: gAAAAABikEVMNp_eSFXwXs3bd9liM_b87uvKMJihtRm8X2RglXyjxfpny2AIFCElnyJMHxb7Ms_uTw2Q-iOHH7gWL3px933g0smauzx9rrEO1AM_I-dfbMifVnsS8RsCNZkYDc5eOfXIQZyYKUrdmTnFY7LoW-0h1eNd7dD_ZBo2rUBQdPKmMj0 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Domain-Id: None May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Domain-Name: None May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Identity-Status: Confirmed May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Is-Admin-Project: True May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Domain-Id: default May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Domain-Name: Default May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Project-Name: admin May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Role: member,admin,reader May 27 03:28:12.886023 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Roles: member,admin,reader May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d3e8df9c2aa4b4588906f73830bd805", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d3e8df9c2aa4b4588906f73830bd805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d3e8df9c2aa4b4588906f73830bd805"}]}] May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant: admin May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant-Id: 4d3e8df9c2aa4b4588906f73830bd805 May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-Tenant-Name: admin May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User: admin May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Domain-Id: default May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Domain-Name: Default May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Id: 93ab1998e69940199adfdba4433a4d08 May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: X-User-Name: admin May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: method: > May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: exception: Flavor 451 could not be found. May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: action_args: {'id': '451'} May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:12.887636 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:12.888690 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: ERROR nova.api.openstack.wsgi May 27 03:28:12.890022 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-371e1197-540d-43cf-a9f6-09d058af4f95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:12.891274 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-371e1197-540d-43cf-a9f6-09d058af4f95 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011981 May 27 03:28:12.891274 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:28:13.738159 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:13.739229 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 27 03:28:13.739631 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:13.925487 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-45f927e2-5f1c-4200-b8e4-ab369122f740 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:14.010592 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-45f927e2-5f1c-4200-b8e4-ab369122f740 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.135398 May 27 03:28:14.011090 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 27 03:28:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:28:14.869672 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:14.870683 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 27 03:28:14.871131 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:15.058585 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-ee84cabb-b6ed-4da3-8082-f6daf0f34734 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:15.142605 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-ee84cabb-b6ed-4da3-8082-f6daf0f34734 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.135151 May 27 03:28:15.143094 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 27 03:28:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:28:16.009595 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:16.010596 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 27 03:28:16.011028 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:16.198250 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-e5d2a7ca-04a2-456e-8a23-9121340a7d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:16.341046 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-e5d2a7ca-04a2-456e-8a23-9121340a7d56 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.194560 May 27 03:28:16.341635 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 27 03:28:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:28:17.215020 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:17.216020 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 27 03:28:17.216416 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:17.403832 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-3231cd97-d6b3-46ca-b87b-7f2fd6d1762d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:17.479419 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-3231cd97-d6b3-46ca-b87b-7f2fd6d1762d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.127121 May 27 03:28:17.480600 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 27 03:28:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:28:18.355105 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:18.356193 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 27 03:28:18.356636 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:18.543858 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-73246009-ad32-49ad-a10b-1e3bbfc3aaeb admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:18.563865 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-73246009-ad32-49ad-a10b-1e3bbfc3aaeb admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070619 May 27 03:28:18.564848 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Fri May 27 03:28:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:20.139181 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.140176 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-ba4ca087-e65a-4e7c-b581-ccc77b06047d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 27 03:29:20.140571 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:20.147653 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:20.198595 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-5b63e0ea-ea16-40c5-87e1-6cc2285d9d39 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.218164 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-5b63e0ea-ea16-40c5-87e1-6cc2285d9d39 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071919 May 27 03:29:20.218700 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:20.239812 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG dbcounter [-] [103871] Writing DB stats nova_api:SELECT=14 {{(pid=103871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:20.243534 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-52f4bb23-1f22-4ea4-9133-c6ab938cf0cf admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.251110 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-52f4bb23-1f22-4ea4-9133-c6ab938cf0cf admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013207 May 27 03:29:20.251973 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:20.263642 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-85b3f1f1-351a-492a-85b2-0d1102a530bc admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.271287 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-85b3f1f1-351a-492a-85b2-0d1102a530bc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011403 May 27 03:29:20.271808 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:20.283065 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.290622 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011367 May 27 03:29:20.291176 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:20.303996 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-0dd651cf-bc4e-4a3a-b044-dea7b780f5a8 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.311429 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-0dd651cf-bc4e-4a3a-b044-dea7b780f5a8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011397 May 27 03:29:20.311945 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:06.610319 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:06.612969 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 27 03:33:06.612969 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:33:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:06.766229 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_api:SELECT=6 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:07.003442 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-004653e8-68b3-4d77-981e-7692fe8037f8 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:07.004608 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:33:07.004608 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: warnings.warn(msg) May 27 03:33:07.005843 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-004653e8-68b3-4d77-981e-7692fe8037f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:07.006288 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-004653e8-68b3-4d77-981e-7692fe8037f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.007115 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-004653e8-68b3-4d77-981e-7692fe8037f8 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:07.007549 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-004653e8-68b3-4d77-981e-7692fe8037f8 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.040955 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-004653e8-68b3-4d77-981e-7692fe8037f8 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.276119 May 27 03:33:07.041511 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 27 03:33:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:33:07.907956 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:07.909010 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 27 03:33:07.909410 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:33:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:08.096492 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-edd53bbb-671a-423e-ad98-4645eb850019 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:08.097666 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:33:08.097666 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: warnings.warn(msg) May 27 03:33:08.098911 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-edd53bbb-671a-423e-ad98-4645eb850019 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.099358 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-edd53bbb-671a-423e-ad98-4645eb850019 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.100143 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-edd53bbb-671a-423e-ad98-4645eb850019 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.100604 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-edd53bbb-671a-423e-ad98-4645eb850019 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.120741 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-edd53bbb-671a-423e-ad98-4645eb850019 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074761 May 27 03:33:08.121233 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 27 03:33:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:33:19.399456 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:19.400453 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 27 03:33:19.401473 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:19.544846 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_cell0:SELECT=4 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:19.545578 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_cell1:SELECT=4 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:19.546193 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG dbcounter [-] [103872] Writing DB stats nova_api:SELECT=8 {{(pid=103872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:19.593567 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-701886f2-e710-4ade-a721-4382762978b2 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:19.594780 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:33:19.594780 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: warnings.warn(msg) May 27 03:33:19.595997 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-701886f2-e710-4ade-a721-4382762978b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.596438 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-701886f2-e710-4ade-a721-4382762978b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.597218 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-701886f2-e710-4ade-a721-4382762978b2 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.597647 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-701886f2-e710-4ade-a721-4382762978b2 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.623232 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-701886f2-e710-4ade-a721-4382762978b2 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083531 May 27 03:33:19.623786 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 27 03:33:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:33:20.486431 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: DEBUG nova.api.openstack.wsgi [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] Calling method '>' {{(pid=103871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:20.487471 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: INFO nova.api.openstack.requestlog [None req-925a4ac3-570d-4738-b50f-41169d42351c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 27 03:33:20.487890 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: [pid: 103871|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 27 03:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:20.675926 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG nova.api.openstack.wsgi [None req-c1aa6779-be08-4dd9-88b4-09caad8e6d01 admin admin] Calling method '>' {{(pid=103872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:20.677093 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:33:20.677093 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: warnings.warn(msg) May 27 03:33:20.678262 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-c1aa6779-be08-4dd9-88b4-09caad8e6d01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:20.678697 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-c1aa6779-be08-4dd9-88b4-09caad8e6d01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:20.679503 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-c1aa6779-be08-4dd9-88b4-09caad8e6d01 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:20.679950 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: DEBUG oslo_concurrency.lockutils [None req-c1aa6779-be08-4dd9-88b4-09caad8e6d01 admin admin] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:20.701259 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: INFO nova.api.openstack.requestlog [None req-c1aa6779-be08-4dd9-88b4-09caad8e6d01 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076683 May 27 03:33:20.701747 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: [pid: 103872|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 27 03:33:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:34:17.438320 dv-cinder-828805-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 03:34:17.439249 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: Fri May 27 03:34:17 2022 - graceful shutdown triggered... May 27 03:34:17.440678 dv-cinder-828805-4-iscsi devstack@n-api.service[103872]: Gracefully killing worker 2 (pid: 103872)... May 27 03:34:17.441167 dv-cinder-828805-4-iscsi devstack@n-api.service[103871]: Gracefully killing worker 1 (pid: 103871)... May 27 03:34:18.441550 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: worker 1 buried after 1 seconds May 27 03:34:18.441550 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: worker 2 buried after 1 seconds May 27 03:34:18.441550 dv-cinder-828805-4-iscsi devstack@n-api.service[103870]: goodbye to uWSGI. May 27 03:34:18.443066 dv-cinder-828805-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 03:34:18.443624 dv-cinder-828805-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 03:34:18.446904 dv-cinder-828805-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:34:18.465200 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:34:18 2022] *** May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: nodename: dv-cinder-828805-4-iscsi May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: machine: x86_64 May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: clock source: unix May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: pcre jit disabled May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: detected number of CPU cores: 4 May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: current working directory: / May 27 03:34:18.481903 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: detected binary path: /usr/bin/uwsgi-core May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: your processes number limit is 47680 May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: your memory page size is 4096 bytes May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: detected max file descriptor number: 2048 May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: lock engine: pthread robust mutexes May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: thunder lock: enabled May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:34:18.482651 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:34:18.529236 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: Python main interpreter initialized at 0x5565c0a419c0 May 27 03:34:18.529236 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: python threads support enabled May 27 03:34:18.529236 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: your server socket listen backlog is limited to 100 connections May 27 03:34:18.529236 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: your mercy for graceful operations on workers is 90 seconds May 27 03:34:18.529702 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:34:18.529805 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: *** Operational MODE: preforking *** May 27 03:34:18.530078 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: *** uWSGI is running in multiple interpreter mode *** May 27 03:34:18.530078 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: spawned uWSGI master process (pid: 124753) May 27 03:34:18.530342 dv-cinder-828805-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:34:18.531100 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: spawned uWSGI worker 1 (pid: 124770, cores: 1) May 27 03:34:18.531288 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: spawned uWSGI worker 2 (pid: 124771, cores: 1) May 27 03:34:18.531582 dv-cinder-828805-4-iscsi devstack@n-api.service[124753]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:34:19.735208 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:34:19.743531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:34:20.527927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:34:20.527927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: from cryptography.utils import int_from_bytes May 27 03:34:20.528230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:34:20.528230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: from cryptography.utils import int_from_bytes May 27 03:34:20.528370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:34:20.528370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: from cryptography.utils import int_from_bytes May 27 03:34:20.528536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:34:20.528536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: from cryptography.utils import int_from_bytes May 27 03:34:22.967907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:34:22.968561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:34:22.968652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:34:22.968955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:34:22.969215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:34:22.969604 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.969937 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.970263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.970366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:34:22.970731 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:34:22.970815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.970939 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.971153 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:34:22.971260 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.971477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:34:22.971581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.971737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:34:22.971840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.972131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.972281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.972402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.972901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.973131 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.973354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.973780 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.974032 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-4-iscsi {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.974198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.974641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.974765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975453 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975798 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.975961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.976062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.976271 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.976380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.976606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.976715 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-4-iscsi {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.976936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.977102 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.977322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.978471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.978603 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.978696 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.978772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.978872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.978949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979273 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.979875 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980220 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980633 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.980961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.981182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-4-iscsi {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.981416 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.981630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.981876 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.982120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.982438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.982795 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.983025 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.983254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.983479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.983687 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.983906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-4-iscsi {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.984160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.984412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.984639 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.984885 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.985065 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.985286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.985444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.985444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.985796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.985982 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.986142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.986288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.986443 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.986639 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.986789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.986959 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.987120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.987364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.987633 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.987805 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.987982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.988140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.988286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.988431 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.988584 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.988742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.989223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.989378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.989524 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.989669 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.989830 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.990454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.990701 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.990908 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991658 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991810 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.991956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.992114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.992268 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.992429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.992579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.992734 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.992913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993072 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993226 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993668 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993668 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.993959 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.994113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.994277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.994277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.995493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.995594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.995686 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.995764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.995843 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.995923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996002 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996330 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996784 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.996865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997273 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997273 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997423 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997503 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997810 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997886 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.997971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998044 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998122 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998568 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998637 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.998920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999080 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:22.999523 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000852 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000997 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.000997 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.001275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.001440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.001587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.001587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.001934 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.002087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.002286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.002438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.002585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.002733 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.002913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.003074 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.003238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.003396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.003544 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.003697 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.003855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004002 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004779 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.004924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.005081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.005230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.005386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.005543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.005690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.005854 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.006001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.006381 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.006537 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.006699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.006869 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007032 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.007952 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.008118 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.008280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.008993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.009155 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.009303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.009465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.009612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.009766 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.009912 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.010057 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.010211 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.010367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.010522 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.010686 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.010855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011798 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.011951 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.012098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.012254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.012408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.012565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.012565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.012858 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013014 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013160 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013306 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013452 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013605 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.013932 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.014079 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.014233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.014385 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.014543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.014703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.014885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.015038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.015038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.015314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.015471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.015617 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.015773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.015929 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.016084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.016259 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.016669 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.016846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.017003 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.017166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.017328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.017490 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.017638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.017798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.017947 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:34:23.018100 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.018100 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.018393 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.018540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.018706 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.018918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.019084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.019239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.019400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.019557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.019704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.019852 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020146 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020456 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020766 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.020913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.021071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.021296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.021458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.021620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.021774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.021934 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.022088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.022241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.022387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.022547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.022695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.022871 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023184 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023810 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.023964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.024132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.024873 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025489 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025645 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025802 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.025956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.026103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.026257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.026412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.026880 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.027067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.027217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.027379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.027542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.027708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.027708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028158 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028609 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.028919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029066 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029368 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029524 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.029994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.030140 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.030295 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.030442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.030597 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.030744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.030920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.031071 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.031218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.031387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.031552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.031756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.031908 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032356 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032515 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032816 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.032970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.033125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.033280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.033436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.033601 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.033750 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.033904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.034088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.034285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.034439 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.034585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.034740 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.034913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.035077 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.035234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.035389 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.035535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.035702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.035857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.036005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.036165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.036319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.036474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.036641 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037192 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037355 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037678 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037827 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.037984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.038145 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.038300 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.038455 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.038455 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.038748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.038942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.039109 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.039257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.039423 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.039570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.039734 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.039896 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040374 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040521 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040675 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040836 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.040984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041744 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.041908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.042194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.042194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.042479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.042635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.042782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.042980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.043138 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.043286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.043431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.043589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.043736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.043900 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044497 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044650 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.044952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.045201 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.045369 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.045524 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.045678 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.045825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.045988 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.046145 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.046307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.046461 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.046608 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.046761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.047024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.047356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.047521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.047679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.047827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.047973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.048127 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.048296 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.048445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.048599 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.048745 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.048891 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.049037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.049192 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.049340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.049493 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.049646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.050335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.050505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.050746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.051572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.051739 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.051888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.052036 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.052182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.052337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.052485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.052640 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.052788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.053173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.053340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.053502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.053650 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.053807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.053963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.054117 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.054265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.054412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.054576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.054929 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.055100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.055248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.055395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.055553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.055717 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.055866 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056012 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056159 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056306 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.056918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.057163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.057553 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.057721 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.057896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058499 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058645 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058802 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.058975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.059133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.059287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.059443 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.059591 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.059760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.059925 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060088 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060249 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060583 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060890 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.060890 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.061197 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.061488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.061679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.061836 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.061990 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.062153 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.062307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.062461 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.062623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.062785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.062975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.063130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.063291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.063444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.063606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.063810 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.063969 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.064123 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.064286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.064449 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.064603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.064756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.064909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.065071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.065224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.065390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.065554 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.065708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.066926 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.067028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.067284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.067463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.067832 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068430 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068601 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068886 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.068979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069204 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069341 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069529 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069791 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069889 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.069983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070077 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070650 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070730 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070801 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.070915 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.071527 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.071674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.071807 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.071956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072090 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072385 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072842 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072842 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.072994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073088 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.073781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074591 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074682 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.074921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075020 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075377 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075651 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075735 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075819 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.075912 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076159 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076243 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076633 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.076823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.077060 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.077199 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.077455 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.077663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.077763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.077988 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.078095 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.078323 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.078442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.078653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.078752 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.079028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.079138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.079329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.079615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.079714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.079937 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.080041 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.080237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.080410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.080572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.080732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.080886 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.081047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.081210 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.081371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.081531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.081691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.082221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.082470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.083322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.083505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.083668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.083832 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.083988 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.084147 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.084308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.084460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.084622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.084776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.084944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.085108 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.085261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.085422 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.085593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.085754 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.085915 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.086075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.086228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.086390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.086550 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.087273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.087437 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.087591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.087754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.087922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088249 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088409 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088553 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088849 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.088995 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.089149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.089293 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.089437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.089593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.089743 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.089893 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090049 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090504 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.090943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091034 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091483 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091653 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.091935 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092432 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.092907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.093181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.093439 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.093532 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.093767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.093850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.094091 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.094180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.094408 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.094488 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.094720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.094808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.095061 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.095159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.095379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.095468 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.095690 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.095779 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.096006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.096099 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.097405 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.097574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.097677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.097766 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.097852 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.097949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098226 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098778 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.098919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100408 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100628 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100805 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.100985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101176 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101271 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101271 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101614 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.101798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.102016 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.102180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.102506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.102615 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.102760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.102941 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103090 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103432 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103621 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.103931 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.104023 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.104236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.104343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.104543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.104643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105427 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105625 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105797 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.105882 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.106049 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.106151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.106355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.106457 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.106660 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.106760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107208 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107414 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107510 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.107898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.108001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.108213 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.108315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.108526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.108619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.108857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109475 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.109867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.110084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.110178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.110392 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.110493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.110711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.110803 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111342 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.111974 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.112074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.112283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.112535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.112635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.112730 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.112918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113475 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113580 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113667 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113847 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.113940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.114157 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.114261 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.114465 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.114557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.114773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.114899 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.115122 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.115217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.115433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.115526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.115745 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.115838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116057 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116152 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116368 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116783 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.116986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.117080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.117294 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.117398 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.117603 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.117713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.117936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.118033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.118272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.118363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.118592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.118694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.118935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119048 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119569 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119700 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119879 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.119976 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.120185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.120285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.120497 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.120609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.120814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.120914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.121129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.121222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.121440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.121535 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.121771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.121873 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.122086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.122180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.122404 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.122643 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.122750 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.122853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.123038 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.123132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.123358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.123504 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.123707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.123852 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.124054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.124154 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.124365 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.124461 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.124672 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.124772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125583 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125667 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125874 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.125984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.126180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.126274 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.126483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.126585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.126806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.126951 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.127134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.127258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.127453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.127580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.127869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.127978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.128182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.128282 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.128488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.128590 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.128804 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.128905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.129138 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.129239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.129452 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.129544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.129766 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.129861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.130079 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.130223 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.130409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.130510 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.130719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.130813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.131056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.131161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.131368 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.131483 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.131695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.131788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.132020 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.132113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.132331 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.132508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.132642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.133159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.133265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.133395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134440 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134709 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.134950 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.135108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.135273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.135435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.135591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.135747 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.135923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.136068 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.136258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.136393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.136564 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.136701 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.136882 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137007 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137318 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137628 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.137948 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.138173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.138280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.138502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.138596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.138814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.138982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.139151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.139259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.139463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.139557 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.139768 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.139888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.140071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.140218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.140393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.140531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.140702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.141237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.141384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.141529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.141623 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.141717 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.141805 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142197 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142303 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142392 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142571 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.142820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143015 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143292 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143600 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.143999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.144251 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.144394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.144561 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.144670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.144881 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.144996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.145200 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.145308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.145527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.145648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.145838 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.145952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.146155 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.146257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.146482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.146604 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.146797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.146945 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.147135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.147235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.147450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.147587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.147752 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.147861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148150 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148671 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.148975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.149098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.149876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.149976 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.150193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.150287 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.150498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.150592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.150808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.150938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.151133 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.151237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.151456 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.151558 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.151761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.151855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.152085 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.152179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.152393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.152487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.152711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.152813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153004 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153423 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153645 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153752 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.153947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.154041 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.154255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.154420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.154566 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.154723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.154920 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155082 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155221 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155328 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155627 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.155949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.156168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.156270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.156478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.156574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.156790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.156885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.157100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.157197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.157413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.157506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.157731 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.157824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.158048 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.158143 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.158361 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.158456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.158677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.158772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.159021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.159118 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.159342 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.159445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.159673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.159905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160014 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160654 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.160975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.161185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.161287 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.161503 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.161653 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.161819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.161937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.162130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.162233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.162440 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.162541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.162751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.162871 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.163089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.163229 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.163417 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.163663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.163773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.164003 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.164114 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.164324 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.164445 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.165246 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.165394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.165495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.165655 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.165817 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.165979 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.166139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.166298 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.166460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.166657 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.166780 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167295 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167443 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167610 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.167949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.168112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.168215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.168445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.168546 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.168792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.168899 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.169121 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.169215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.169436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.169611 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.169779 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.169930 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.170075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.170219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.170363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.170512 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.170668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.170811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171004 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171101 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171301 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.171934 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.172030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.172246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.172350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.172561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.172655 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.172906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.173176 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.173325 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.173446 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.173582 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.173701 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.173834 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.174025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.174157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.174348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.174479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.174665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.174813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175340 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175462 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175648 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.175955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.176090 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.176265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.176411 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.176574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.176878 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.176969 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.177201 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.177304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.177513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.177606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.177817 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.177923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.178138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.178236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.178449 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.178544 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.178829 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.179009 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.179183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.179359 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.179498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.179675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.179813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.180001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.180132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.180346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181329 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181822 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.181983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.182130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.182302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.182435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.182631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.182749 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.182971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.183080 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.183392 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.183597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.183831 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.184078 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.184252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.184400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.184556 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.184713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.184870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185023 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185172 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185371 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185459 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.185877 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.186070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.186164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.186376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.186479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.186689 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.186783 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187020 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187421 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187724 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.187935 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188550 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.188964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.189164 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.189265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.189475 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.189584 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.189780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.189881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.190089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.190193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.190398 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.190506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.190717 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.190812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191155 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191682 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191784 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.191992 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.192085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.192314 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.192420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.192626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.192721 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.192938 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.193034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.193248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.193357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.193600 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.193697 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.193862 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.194113 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.194305 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.194463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.194614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.194771 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.194965 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.195127 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.195282 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.195413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.195508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.195723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.195838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.196065 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.196183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.196373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.196468 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.196698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.196790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197011 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.197947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.198233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.198373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.198555 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.198655 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.199135 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.199257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.199454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.199547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.199764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.199865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.200073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.200167 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.200383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.200477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.200692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.200786 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201305 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201480 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201730 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.201952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.202055 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.202266 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.202357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.202583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.202683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.202922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203701 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203857 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.203966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.204169 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.204315 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.204482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.204590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.204799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.204893 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.205111 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.205202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.205417 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.205527 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.205763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206469 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206563 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.206803 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.207058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.207154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.207377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.207479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.207695 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.207788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208610 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.208942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.209136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.209251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.209344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.209562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.209712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.209900 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210049 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210203 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210491 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.210988 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.211135 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.211279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.211424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.211588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.211867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.211967 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.212210 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.212303 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.212545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.212639 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.212864 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.212962 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.213170 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.213264 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.213479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.213574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.213861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.213966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.214077 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.214180 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.214411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.214510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.214679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.214774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215009 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215105 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215451 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215617 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.215920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216292 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216613 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216702 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216816 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.216911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.217120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.217225 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.217422 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.217517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.217724 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.217818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.218071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.218184 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.218356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.218480 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.218680 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.218785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219425 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219737 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.219957 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220053 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220892 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.220988 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.221206 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.221302 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.221514 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.221607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.221823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.221917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.222133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.222228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.222442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.222549 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.222753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.222876 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.223087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.223212 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.223397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.223552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.223708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.223928 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224343 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224463 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224755 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.224973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.225068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.225291 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.225403 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.225614 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.225726 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.225931 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.226026 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.226243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.226397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.226563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.226691 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.227673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.227806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.227806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.227999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228097 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228463 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228753 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.228966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.229069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.229283 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.229397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.229608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.229701 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.229931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.230024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.230241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.230350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.230567 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.230670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.230914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.231051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.231257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.231370 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.231576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.231686 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.231891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232032 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232535 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232849 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.232982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.233155 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.233254 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.233399 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:34:23.233502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.233804 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.234142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.234457 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.234794 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.235153 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.235506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.235829 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.236180 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.236517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.236844 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.237167 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.237482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:34:23.237733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:34:23.292734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Registered counter for database nova_api May 27 03:34:23.297632 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Registered counter for database nova_api May 27 03:34:23.312953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.317504 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.320470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.325223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.377964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.context [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e92bf5b-a7a5-461c-810d-6697c81d065e(cell1) {{(pid=124771) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:34:23.382113 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.383779 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.384588 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.386632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.387114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.context [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e92bf5b-a7a5-461c-810d-6697c81d065e(cell1) {{(pid=124770) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:34:23.388631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Registered counter for database nova_cell0 May 27 03:34:23.391362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.392596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Registered counter for database nova_cell1 May 27 03:34:23.392962 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.393772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.396074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.398082 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Registered counter for database nova_cell0 May 27 03:34:23.402326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.402952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Registered counter for database nova_cell1 May 27 03:34:23.403124 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.410108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.410291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.411739 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.412039 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.418299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.420947 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.557497 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Registered counter for database nova_cell0 May 27 03:34:23.564137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.569330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO dbcounter [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Registered counter for database nova_cell0 May 27 03:34:23.569500 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.577357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_db.sqlalchemy.engines [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:34:23.582537 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writer thread running {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:34:23.889097 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:34:23.896326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:34:23.911935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:34:23.922525 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:34:24.240901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:34:24.248013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-e3ebe0dd-7206-4d29-841e-028edd4829d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:34:24.253329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565c0a419c0 pid: 124771 (default app) May 27 03:34:24.283542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:34:24.291099 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: WARNING keystonemiddleware.auth_token [None req-121cf936-a265-4544-8580-c03cf50fc564 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:34:24.296542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565c0a419c0 pid: 124770 (default app) May 27 03:35:05.090290 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:05.091260 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:05.092160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:05.092916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:06.211823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-652e85b0-b9d1-4726-a5e5-eedb9666f1c5 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Action: 'create', calling method: .version_select at 0x7f3048737ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1074386747", "metadata": {"Type": "work"}}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:06.364533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:06.366203 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:06.367015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:06.368139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:07.672673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e3a2c719-0ff0-4240-b521-ff3d9f56e797 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Action: 'create', calling method: .version_select at 0x7f3048739c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-977063217", "metadata": {"Type": "work"}}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e3a2c719-0ff0-4240-b521-ff3d9f56e797 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Request method failure captured: May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 121 May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbqxXim_z5uCJOiy4E3uxLpyjX4JXD34UVj-PYGHkGOxNSgLLqjfCKkcQf4aQnZjEL9-2xyljLYQiMmWJBgGSLnx742B48JPZ6fSo-3kPg6hf_cUFEqTcnj6j0eIH_gwOVqsVeWkqTSgKeI2T1XnbqO9xpUIYr91p2aJMS4bszDx_0 May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:07.690312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c1d79b4ed73547e8ac943686bc7661df", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c1d79b4ed73547e8ac943686bc7661df"}]}] May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-20921904-project May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 78120e5efd9a429ebf508a26d2b7bc6b May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-20921904-project May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-977063217", "metadata": {"Type": "work"}}} May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:07.691799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-977063217', 'metadata': {'Type': 'work'}}}} May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise error May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi '#$%' May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:07.692634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:35:07.694594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:35:07.697852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:35:07.697852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.697852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e3a2c719-0ff0-4240-b521-ff3d9f56e797 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:07.697852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e3a2c719-0ff0-4240-b521-ff3d9f56e797 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.333066 May 27 03:35:07.697852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 27 03:35:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:35:07.708613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-db4f57ea-9195-40a1-b5dc-29c10826ff21 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Action: 'create', calling method: .version_select at 0x7f304861fee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-330570814", "metadata": {"Type": "work"}}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-db4f57ea-9195-40a1-b5dc-29c10826ff21 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Request method failure captured: May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 119 May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbqxXim_z5uCJOiy4E3uxLpyjX4JXD34UVj-PYGHkGOxNSgLLqjfCKkcQf4aQnZjEL9-2xyljLYQiMmWJBgGSLnx742B48JPZ6fSo-3kPg6hf_cUFEqTcnj6j0eIH_gwOVqsVeWkqTSgKeI2T1XnbqO9xpUIYr91p2aJMS4bszDx_0 May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:07.709435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c1d79b4ed73547e8ac943686bc7661df", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c1d79b4ed73547e8ac943686bc7661df"}]}] May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-20921904-project May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 78120e5efd9a429ebf508a26d2b7bc6b May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-20921904-project May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-330570814", "metadata": {"Type": "work"}}} May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:07.711063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-330570814', 'metadata': {'Type': 'work'}}}} May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise error May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi '0' May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:07.712024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:35:07.713380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:35:07.714456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:35:07.714456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.715727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-db4f57ea-9195-40a1-b5dc-29c10826ff21 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:07.716814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-db4f57ea-9195-40a1-b5dc-29c10826ff21 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015817 May 27 03:35:07.717951 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 2/2] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 27 03:35:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:35:07.730073 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5600552-5722-460e-a3b6-5c87ab25e49c tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Action: 'create', calling method: .version_select at 0x7f304861f0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-725737494", "metadata": {"Type": "work"}}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5600552-5722-460e-a3b6-5c87ab25e49c tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Request method failure captured: May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 118 May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbqxXim_z5uCJOiy4E3uxLpyjX4JXD34UVj-PYGHkGOxNSgLLqjfCKkcQf4aQnZjEL9-2xyljLYQiMmWJBgGSLnx742B48JPZ6fSo-3kPg6hf_cUFEqTcnj6j0eIH_gwOVqsVeWkqTSgKeI2T1XnbqO9xpUIYr91p2aJMS4bszDx_0 May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:07.731493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c1d79b4ed73547e8ac943686bc7661df", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c1d79b4ed73547e8ac943686bc7661df"}]}] May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-20921904-project May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 78120e5efd9a429ebf508a26d2b7bc6b May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-20921904-project May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-725737494", "metadata": {"Type": "work"}}} May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:07.732747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-725737494', 'metadata': {'Type': 'work'}}}} May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise error May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi '' May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:07.733528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:35:07.734811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:35:07.736056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:35:07.736056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:07.738700 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5600552-5722-460e-a3b6-5c87ab25e49c tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:07.739818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e5600552-5722-460e-a3b6-5c87ab25e49c tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015279 May 27 03:35:07.741543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 3/3] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 27 03:35:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:35:07.750959 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2fc2b7d0-c6cb-49a0-85e0-f04c6a01f106 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Calling method '.version_select at 0x7f30485e9b80>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:08.876937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-2fc2b7d0-c6cb-49a0-85e0-f04c6a01f106 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] HTTP exception thrown: Volume tempest-invalid-431810388 could not be found. May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2fc2b7d0-c6cb-49a0-85e0-f04c6a01f106 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Request method failure captured: May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-431810388 HTTP/1.1 May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbqxXim_z5uCJOiy4E3uxLpyjX4JXD34UVj-PYGHkGOxNSgLLqjfCKkcQf4aQnZjEL9-2xyljLYQiMmWJBgGSLnx742B48JPZ6fSo-3kPg6hf_cUFEqTcnj6j0eIH_gwOVqsVeWkqTSgKeI2T1XnbqO9xpUIYr91p2aJMS4bszDx_0 May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:08.885162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c1d79b4ed73547e8ac943686bc7661df", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c1d79b4ed73547e8ac943686bc7661df"}]}] May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-20921904 May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-20921904-project May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 78120e5efd9a429ebf508a26d2b7bc6b May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-20921904-project May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Volume tempest-invalid-431810388 could not be found. May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'tempest-invalid-431810388'} May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:08.887345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-431810388 could not be found. (HTTP 404) (Request-ID: req-ef5b3be7-b758-4c08-bfbc-fdf39b8e9ce3) May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:08.888190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:35:09.093684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-431810388 could not be found. May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:09.099054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-431810388 could not be found. May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-431810388 could not be found. May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2fc2b7d0-c6cb-49a0-85e0-f04c6a01f106 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Returning 404 to user: Volume tempest-invalid-431810388 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2fc2b7d0-c6cb-49a0-85e0-f04c6a01f106 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-431810388" status: 404 len: 98 microversion: 2.1 time: 1.145337 May 27 03:35:09.105570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 4/4] 10.222.0.24 () {58 vars in 1214 bytes} [Fri May 27 03:35:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-431810388 => generated 98 bytes in 1147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 03:35:09.111567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ed683c0c-0bad-441d-8bcf-c9b688b1c76c tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004979 May 27 03:35:09.111567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 5/5] 10.222.0.24 () {58 vars in 1139 bytes} [Fri May 27 03:35:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:35:09.111567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ecf6d698-0828-4e4e-b5a0-8fbad51fe0e9 tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009113 May 27 03:35:09.111567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 6/6] 10.222.0.24 () {58 vars in 1136 bytes} [Fri May 27 03:35:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:35:09.111567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ded2aabf-66a5-400f-b877-9e84d928206a tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Calling method '.version_select at 0x7f304851e0d0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:09.113788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-652e85b0-b9d1-4726-a5e5-eedb9666f1c5 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.891740 May 27 03:35:09.113788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 1/7] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 27 03:35:05 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3894 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 03:35:09.113788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bb1b2ad2-84c6-4f5d-8d2e-aa45db8a75a6 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Calling method '.version_select at 0x7f3048588c10>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-ded2aabf-66a5-400f-b877-9e84d928206a tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] HTTP exception thrown: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ded2aabf-66a5-400f-b877-9e84d928206a tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Request method failure captured: May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/os-volumes/1bedd85c-8b19-4824-b3f0-2185352ee6b0 HTTP/1.1 May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbqxXim_z5uCJOiy4E3uxLpyjX4JXD34UVj-PYGHkGOxNSgLLqjfCKkcQf4aQnZjEL9-2xyljLYQiMmWJBgGSLnx742B48JPZ6fSo-3kPg6hf_cUFEqTcnj6j0eIH_gwOVqsVeWkqTSgKeI2T1XnbqO9xpUIYr91p2aJMS4bszDx_0 May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:09.120769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c1d79b4ed73547e8ac943686bc7661df", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c1d79b4ed73547e8ac943686bc7661df"}]}] May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-20921904 May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-20921904-project May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 78120e5efd9a429ebf508a26d2b7bc6b May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-20921904-project May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '1bedd85c-8b19-4824-b3f0-2185352ee6b0'} May 27 03:35:09.126218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. (HTTP 404) (Request-ID: req-515d989a-40b6-4f9b-8910-e6d4148ad324) May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.133542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:35:09.156051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:35:09.157076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ded2aabf-66a5-400f-b877-9e84d928206a tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Returning 404 to user: Volume 1bedd85c-8b19-4824-b3f0-2185352ee6b0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ded2aabf-66a5-400f-b877-9e84d928206a tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/1bedd85c-8b19-4824-b3f0-2185352ee6b0" status: 404 len: 109 microversion: 2.1 time: 0.109792 May 27 03:35:09.157958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 7/8] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:35:08 2022] DELETE /compute/v2.1/os-volumes/1bedd85c-8b19-4824-b3f0-2185352ee6b0 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:09.158572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0c1d078a-03c2-4760-a2fd-886f01d695ba tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Calling method '.version_select at 0x7f304851e3a0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:09.158631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bb1b2ad2-84c6-4f5d-8d2e-aa45db8a75a6 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef" status: 200 len: 353 microversion: 2.1 time: 0.162834 May 27 03:35:09.158631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 2/9] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:35:08 2022] GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:09.472825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-0c1d078a-03c2-4760-a2fd-886f01d695ba tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] HTTP exception thrown: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0c1d078a-03c2-4760-a2fd-886f01d695ba tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Request method failure captured: May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 HTTP/1.1 May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbqxXim_z5uCJOiy4E3uxLpyjX4JXD34UVj-PYGHkGOxNSgLLqjfCKkcQf4aQnZjEL9-2xyljLYQiMmWJBgGSLnx742B48JPZ6fSo-3kPg6hf_cUFEqTcnj6j0eIH_gwOVqsVeWkqTSgKeI2T1XnbqO9xpUIYr91p2aJMS4bszDx_0 May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:09.475652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c1d79b4ed73547e8ac943686bc7661df", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c1d79b4ed73547e8ac943686bc7661df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c1d79b4ed73547e8ac943686bc7661df"}]}] May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesNegativeTest-20921904 May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: c1d79b4ed73547e8ac943686bc7661df May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesNegativeTest-20921904 May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesNegativeTest-20921904-project May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 78120e5efd9a429ebf508a26d2b7bc6b May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesNegativeTest-20921904-project May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143'} May 27 03:35:09.480875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. (HTTP 404) (Request-ID: req-446ee38d-19f4-487f-a40a-e19f3025dcc5) May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.481838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:35:09.482684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:35:09.483568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0c1d078a-03c2-4760-a2fd-886f01d695ba tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] Returning 404 to user: Volume 21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0c1d078a-03c2-4760-a2fd-886f01d695ba tempest-VolumesNegativeTest-20921904 tempest-VolumesNegativeTest-20921904-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143" status: 404 len: 109 microversion: 2.1 time: 0.421837 May 27 03:35:09.484377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 8/10] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:35:09 2022] GET /compute/v2.1/os-volumes/21b161ec-8ad1-4f55-9ccd-cf1a1b4a2143 => generated 109 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:09.517601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-48634017", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "networks": [{"uuid": "eb82f03a-aca5-4360-8d95-46822d61d016"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:09.797690 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] validate_networks() for [('eb82f03a-aca5-4360-8d95-46822d61d016', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:35:10.158713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0594e563-6efb-46e2-bdec-5793a894ce45 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Calling method '.version_select at 0x7f3048506c10>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:10.368503 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0594e563-6efb-46e2-bdec-5793a894ce45 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef" status: 200 len: 354 microversion: 2.1 time: 0.214640 May 27 03:35:10.369569 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 9/11] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:35:10 2022] GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:10.380119 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e3655e0f-559a-48f0-897f-44df1b9f87d5 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Calling method '.version_select at 0x7f30485e95e0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:10.528466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e3655e0f-559a-48f0-897f-44df1b9f87d5 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef" status: 200 len: 354 microversion: 2.1 time: 0.148922 May 27 03:35:10.530688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 10/12] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:35:10 2022] GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:10.551226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-53164a58-07ce-4e3b-bb57-88348fe5ffaa tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Calling method '.version_select at 0x7f30485e91f0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:10.931706 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-53164a58-07ce-4e3b-bb57-88348fe5ffaa tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef" status: 202 len: 0 microversion: 2.1 time: 0.385323 May 27 03:35:10.935820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 11/13] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:35:10 2022] DELETE /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:35:10.947618 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-17237ca2-6bc7-48c4-8283-2b68e4b31570 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Calling method '.version_select at 0x7f304851e820>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:11.068598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-17237ca2-6bc7-48c4-8283-2b68e4b31570 tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef" status: 200 len: 353 microversion: 2.1 time: 0.130959 May 27 03:35:11.090890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 12/14] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:35:10 2022] GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:11.863020 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:35:11.863777 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:35:11.864246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:35:11.864784 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:35:11.872300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:35:11.886465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:11.887431 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:11.888454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:11.889089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:11.964263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Getting quotas for project e3b236cd8e9049e6acdeb545f5d3382d. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:35:11.977832 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Getting quotas for user 8584a3f99b0144979f69536f7cc86851 and project e3b236cd8e9049e6acdeb545f5d3382d. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:35:11.996889 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:35:12.001338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:35:12.085579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e59bf4f-e68b-4542-ac68-8a3e694539ee tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Calling method '.version_select at 0x7f30485e9700>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:12.149896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-5e59bf4f-e68b-4542-ac68-8a3e694539ee tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] HTTP exception thrown: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e59bf4f-e68b-4542-ac68-8a3e694539ee tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Request method failure captured: May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef HTTP/1.1 May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbp5d-qBEPYlkmyMoIoZtBcuwXUFMimHJBF3Emc5Rotv9Ew2SG3z_vqqmEmtat-7iIdWUY96aP1TcVX8pBBB-1oGPF6HXyHdXGQPsf9hLV0ONltMfHq0gb6oZp3UsfY25zhSWDBmBe2P5f067YzfBCwXI7zJfG_gaH5D6WYl7jB1Kg May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 5f8d42bcfc0947baa7debb6c4eb692c7 May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesGetTestJSON-1380146133 May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:35:12.151921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5f8d42bcfc0947baa7debb6c4eb692c7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f8d42bcfc0947baa7debb6c4eb692c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f8d42bcfc0947baa7debb6c4eb692c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5f8d42bcfc0947baa7debb6c4eb692c7"}]}] May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesGetTestJSON-1380146133 May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 5f8d42bcfc0947baa7debb6c4eb692c7 May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesGetTestJSON-1380146133 May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesGetTestJSON-1380146133-project May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 1d6495f63468440991b39a43a11c856b May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesGetTestJSON-1380146133-project May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '032a9344-7dbe-4ade-afaf-0e0b64f94eef'} May 27 03:35:12.152989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. (HTTP 404) (Request-ID: req-5570248b-3316-4fdd-937b-5b46e7f6e3f8) May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:12.153625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:35:12.154551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:35:12.155460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e59bf4f-e68b-4542-ac68-8a3e694539ee tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] Returning 404 to user: Volume 032a9344-7dbe-4ade-afaf-0e0b64f94eef could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e59bf4f-e68b-4542-ac68-8a3e694539ee tempest-VolumesGetTestJSON-1380146133 tempest-VolumesGetTestJSON-1380146133-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef" status: 404 len: 109 microversion: 2.1 time: 0.073041 May 27 03:35:12.156291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 13/15] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:35:12 2022] GET /compute/v2.1/os-volumes/032a9344-7dbe-4ade-afaf-0e0b64f94eef => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:12.219684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4b9c1ae1-5d67-4584-aafa-75e284bf1acb tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836704 May 27 03:35:12.220565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 3/16] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:35:12.232085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c217f629-dd2a-47dc-9439-58e9bc91bb00 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:12.232843 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c217f629-dd2a-47dc-9439-58e9bc91bb00 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:12.462610 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c217f629-dd2a-47dc-9439-58e9bc91bb00 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:12.514572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c217f629-dd2a-47dc-9439-58e9bc91bb00 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1213 microversion: 2.1 time: 0.285452 May 27 03:35:12.516412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 14/17] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:12 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:13.537785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-118b9dbe-abfd-45c3-8dae-61c646081eb2 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:13.538454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-118b9dbe-abfd-45c3-8dae-61c646081eb2 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:13.848284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-118b9dbe-abfd-45c3-8dae-61c646081eb2 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:13.899290 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-118b9dbe-abfd-45c3-8dae-61c646081eb2 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1213 microversion: 2.1 time: 0.368819 May 27 03:35:13.906199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 4/18] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:13 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1213 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:14.926246 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1b429f56-6ed3-4b37-b85f-5cdc9a67ace7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:14.926987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1b429f56-6ed3-4b37-b85f-5cdc9a67ace7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:15.616607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1b429f56-6ed3-4b37-b85f-5cdc9a67ace7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:15.651546 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1b429f56-6ed3-4b37-b85f-5cdc9a67ace7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1213 microversion: 2.1 time: 0.730783 May 27 03:35:15.653541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 15/19] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:14 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1213 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:16.675322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:16.676652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:16.699421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:16.707537 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:16.709962 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:16.716228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:17.231951 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:17.293470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cc0d9b94-4fd2-474f-8449-5875b53e22a8 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1217 microversion: 2.1 time: 0.620097 May 27 03:35:17.295654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 5/20] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:16 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1217 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:18.156887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-53c41169-40b3-4b34-9cd7-3b22e6195114 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'create', calling method: .version_select at 0x7f30484dd280>, body: {"keypair": {"name": "tempest-keypair-853555635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzm8iVo11Nu0Aj21VvvlReu18tJBRfhW6ToIDMquAeyYBVRnIx3GI/7zlVj9obTAYKHl7hkWyX3McpjKCZmnt92sQjNEjkRV/0ijhpr9GqGd7rIZsoFk+xVMuWyOjS6UA=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:18.315854 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:18.317483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:18.329767 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:18.333262 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:18.336504 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-53c41169-40b3-4b34-9cd7-3b22e6195114 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for project 1377b9e588bd44f3b29b03728c418151. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:35:18.351619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:18.355359 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:18.364311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-53c41169-40b3-4b34-9cd7-3b22e6195114 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for user 104a135932a144269f1f2aa7359098ed and project 1377b9e588bd44f3b29b03728c418151. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:35:18.530763 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:18.549787 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e9468461-3d63-40f2-90fa-1c258ea8491c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1217 microversion: 2.1 time: 0.240747 May 27 03:35:18.550387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 6/21] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:18 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:18.612112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-53c41169-40b3-4b34-9cd7-3b22e6195114 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.739624 May 27 03:35:18.612711 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 16/22] 10.222.0.24 () {62 vars in 1199 bytes} [Fri May 27 03:35:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 741 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 03:35:19.575431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:19.576094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:19.584136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:19.584694 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:19.585534 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:19.585976 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:19.742001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-96a999d4-0b7c-43a6-8ac6-199c4abbcdde tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: .version_select at 0x7f3047381a60>, body: {"keypair": {"name": "tempest-keypair-1267530697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR0nIaP3oxTNoysrSjuz7BmjqAypdUtND/3DhgIDF0/Jm97BZXbtQmkaBBroA8+6ushs90y4STCG/qevWgbaLtbkmWaDGKhtUUUh73eLMFE3qDg+pdFHwTd4/q3hcJW2A=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:19.804620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-96a999d4-0b7c-43a6-8ac6-199c4abbcdde tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:35:19.815160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-96a999d4-0b7c-43a6-8ac6-199c4abbcdde tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:35:19.889447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:19.904068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-30977755-1a5d-4cc3-92fe-300b869988f1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1209 microversion: 2.1 time: 0.340335 May 27 03:35:19.904663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 17/23] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:19 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1209 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:20.003860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-96a999d4-0b7c-43a6-8ac6-199c4abbcdde tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.018879 May 27 03:35:20.004673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 7/24] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:35:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:20.922149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:20.923056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:20.933068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:20.939509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:20.940463 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:20.942077 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:21.242773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:21.254566 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24676242-d4ba-4230-858d-3c8ac6cdb96a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1273 microversion: 2.1 time: 0.336679 May 27 03:35:21.263294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 18/25] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:20 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:22.279598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:22.319631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:22.322996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:22.370865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:22.375027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:22.378923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:22.379764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:22.604335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:22.622314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8e148fdb-a3d8-4603-84a1-04e276c80303 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1271 microversion: 2.1 time: 0.347742 May 27 03:35:22.625357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 8/26] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:22 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1271 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:23.096578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1065425472", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85c37aa4-afb9-42cc-ab9f-3e1ebf705aa1"}], "security_groups": [{"name": "tempest-securitygroup--2052277398"}], "key_name": "tempest-keypair-853555635", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:23.436617 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] validate_networks() for [('85c37aa4-afb9-42cc-ab9f-3e1ebf705aa1', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:35:23.644947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:23.646770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:23.656886 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:23.667622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:23.668901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:23.669502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:24.726486 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:24.734942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1618917c-ef66-4086-9b73-488bd73ce67a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 1.094586 May 27 03:35:24.736658 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 9/27] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:23 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:25.754165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:25.754715 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:25.765516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:25.765987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:25.769814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:25.770293 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:26.007816 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:35:26.009777 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:35:26.011094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:35:26.023545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:35:26.023545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:35:26.023545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:26.023545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:26.024525 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:26.026005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:26.060729 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for project 1377b9e588bd44f3b29b03728c418151. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:35:26.117717 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for user 104a135932a144269f1f2aa7359098ed and project 1377b9e588bd44f3b29b03728c418151. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:35:26.185879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:35:26.195290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:35:26.465715 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-49a34886-9e73-4d57-b2a3-0d3697cb22e7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.373501 May 27 03:35:26.471926 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 19/28] 10.222.0.24 () {62 vars in 1187 bytes} [Fri May 27 03:35:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 3381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:35:26.482732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1304830116", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24e2e56a-4202-49e3-9751-4bcdb4e8a6ed"}], "security_groups": [{"name": "tempest-securitygroup--699147423"}], "key_name": "tempest-keypair-1267530697", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:26.961881 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:26.976666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7c15819a-76ca-4cb5-b29c-dc5a88a40f0d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 1.222198 May 27 03:35:26.976997 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 10/29] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:25 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:26.988410 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-763975e9-c478-4535-b5dc-00b52ad98dc4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:26.989180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-763975e9-c478-4535-b5dc-00b52ad98dc4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:27.125116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] validate_networks() for [('24e2e56a-4202-49e3-9751-4bcdb4e8a6ed', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:35:27.283762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-763975e9-c478-4535-b5dc-00b52ad98dc4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:27.293643 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-763975e9-c478-4535-b5dc-00b52ad98dc4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:27.298455 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-763975e9-c478-4535-b5dc-00b52ad98dc4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:27.303206 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-763975e9-c478-4535-b5dc-00b52ad98dc4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1281 microversion: 2.20 time: 0.324621 May 27 03:35:27.307434 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 11/30] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:26 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:27.992720 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:28.005659 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:35:28.006507 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:35:28.008655 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:35:28.009330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:35:28.010936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:35:28.017738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:28.038447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:28.038937 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:28.039709 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:28.045606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:28.046593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:28.047029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:28.048757 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:28.051178 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:28.101261 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:35:28.130303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:35:28.167767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:35:28.174171 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:35:28.326506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:28.328474 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f0fefb9a-dc4f-4501-946f-0989619f3f5e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.340173 May 27 03:35:28.333021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 12/31] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:27 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:28.352031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5382ca0c-d27e-4177-9a44-711f5405795d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:28.355573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5382ca0c-d27e-4177-9a44-711f5405795d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:28.364119 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4a72bc84-9dad-467a-aa46-0d5110c5dc72 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.888114 May 27 03:35:28.367160 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 20/32] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:35:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:35:28.378511 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a6b7b380-c2b9-4541-b721-793ba81cf851 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:28.387792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a6b7b380-c2b9-4541-b721-793ba81cf851 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:28.745527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5382ca0c-d27e-4177-9a44-711f5405795d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:28.754736 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5382ca0c-d27e-4177-9a44-711f5405795d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:28.757145 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5382ca0c-d27e-4177-9a44-711f5405795d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:28.758249 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5382ca0c-d27e-4177-9a44-711f5405795d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1281 microversion: 2.20 time: 0.423357 May 27 03:35:28.758825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 13/33] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:28 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1281 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:28.847376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a6b7b380-c2b9-4541-b721-793ba81cf851 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:28.860437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a6b7b380-c2b9-4541-b721-793ba81cf851 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1242 microversion: 2.1 time: 0.485777 May 27 03:35:28.865524 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 21/34] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:28 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1242 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:29.100055 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-77c6d798-23cc-4564-a92b-a95710cf484c req-11c9d8d1-c28e-497f-9768-ba0e272a376d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b512bc5-a49b-4745-9fee-f78929ca3611", "tag": "96824533-804b-471b-8dd5-0a9fd558c227"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:29.111691 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-77c6d798-23cc-4564-a92b-a95710cf484c req-11c9d8d1-c28e-497f-9768-ba0e272a376d service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.112144 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-77c6d798-23cc-4564-a92b-a95710cf484c req-11c9d8d1-c28e-497f-9768-ba0e272a376d service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.131150 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-77c6d798-23cc-4564-a92b-a95710cf484c req-11c9d8d1-c28e-497f-9768-ba0e272a376d service nova] Creating event network-changed:96824533-804b-471b-8dd5-0a9fd558c227 for instance 7b512bc5-a49b-4745-9fee-f78929ca3611 on hv-cinder-82880 May 27 03:35:29.131677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-77c6d798-23cc-4564-a92b-a95710cf484c req-11c9d8d1-c28e-497f-9768-ba0e272a376d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 03:35:29.132753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.133188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.134129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.134376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.143333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.compute.rpcapi [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 03:35:29.144216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] Releasing lock "compute-rpcapi-router" {{(pid=124771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 03:35:29.161091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b5688130-363b-4313-ab6d-46a2575b1140 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125275 May 27 03:35:29.162479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 14/35] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:29.349691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:29.352033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:29.360065 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.361052 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.361933 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.362441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.709711 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:29.717719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-34ab70df-7b22-43cd-ad09-298dc245155c tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.372013 May 27 03:35:29.718491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 22/36] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:29 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:29.781606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:29.782321 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:29.790571 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.795198 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.796125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.796592 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.879890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:29.882097 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:29.892570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.892834 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:29.897510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:29.898161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.054657 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:30.057018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:30.063495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:30.064976 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cadb6da8-da9b-47e5-a564-d98778377efd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1246 microversion: 2.1 time: 0.189117 May 27 03:35:30.065390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 23/37] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:29 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:30.065504 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:30.066650 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-11097d08-9216-493e-b3f6-429446789666 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1285 microversion: 2.20 time: 0.292656 May 27 03:35:30.078147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 15/38] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:29 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:30.741878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:30.743162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:30.770631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:30.771334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.775442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:30.775442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.956241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:30.966568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-65681214-22d1-4904-aad8-9a2876dc486d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.231013 May 27 03:35:30.967674 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 24/39] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:30 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:31.085221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.086632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:31.093222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.093679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.094453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.094911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.097743 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.098461 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:31.108061 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.108982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.110017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.110654 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.185164 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:31.193948 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-57fc85d2-12dd-4e23-b4bd-1112d0821271 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1246 microversion: 2.1 time: 0.114340 May 27 03:35:31.203429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 16/40] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:31 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:31.214489 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:31.223173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:31.224852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:31.225969 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-562df698-8acc-4c5b-9b31-883f8ac01b3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1285 microversion: 2.20 time: 0.134030 May 27 03:35:31.226519 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 25/41] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:31 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:31.990430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.995850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.002719 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.003540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.004524 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.010518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.223642 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:32.226808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.251930 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.253603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.254136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.254647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.258497 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:32.266616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0dd6d1f9-640b-4aa4-8317-4357ea8c9de6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.281295 May 27 03:35:32.276699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 17/42] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:31 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:32.281844 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:32.282543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.290119 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.290962 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.291981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.292632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.360010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:32.372759 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-96e59ff3-3ec9-4993-8fb9-34b4c7b575ae tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1246 microversion: 2.1 time: 0.162681 May 27 03:35:32.385560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 26/43] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:32 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:32.429636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:32.438599 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:32.440168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:32.441291 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-718c4940-a805-4f38-9523-9df265d86020 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1285 microversion: 2.20 time: 0.163354 May 27 03:35:32.441856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 18/44] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:32 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:33.284382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:33.285009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:33.295007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.295007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.296208 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.296659 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.387559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:33.388222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:33.398939 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.400393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.400393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.400570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.451542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:33.459644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-31aa6cf9-a409-412b-a99e-b69c49b3d8dc tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.179533 May 27 03:35:33.465456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 27/45] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:33 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:33.465456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:33.469814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:33.479388 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.482159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.483239 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.483923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.541533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:33.557905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f851fe46-fa92-487e-bef9-76c8d6449b7a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1246 microversion: 2.1 time: 0.173756 May 27 03:35:33.559899 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 19/46] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:33 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:33.579633 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:33.588762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:33.590537 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:33.591967 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a495a8c1-b52d-4171-8270-421c1177b000 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1285 microversion: 2.20 time: 0.130519 May 27 03:35:33.593030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 28/47] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:33 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:34.477613 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:34.478225 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:34.487794 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.488254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.489158 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.489675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.584254 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:34.584944 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:34.591950 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.592509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.593418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.594085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.691231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:34.708264 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c2192c03-7592-4e12-94e5-80287008c43c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1246 microversion: 2.1 time: 0.128167 May 27 03:35:34.712477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 29/48] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:34 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:34.722181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:34.726895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:34.768538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.768538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.768538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.768538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.769380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:34.769380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e6410ce6-84c6-4991-aeef-4e77881c1719 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.290508 May 27 03:35:34.769380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 20/49] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:34 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:34.840916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:34.852238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:34.854945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:34.856440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-44051e24-1e1b-43bf-80b2-d85812038311 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1285 microversion: 2.20 time: 0.142620 May 27 03:35:34.857014 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 30/50] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:34 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:35.733286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:35.743223 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:35.744376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:35.745904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:35.746413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:35.749542 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:35.750198 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:35.758095 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=79 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:35.783578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:35.784313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:35.791103 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:35.792117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:35.793149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:35.793995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:35.967516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:35.983891 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-78b1e875-25b9-46cb-8fed-5c64455c52ad tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1238 microversion: 2.1 time: 0.257695 May 27 03:35:35.984630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 21/51] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:35 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1238 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:36.003099 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:36.014802 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:36.025408 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:36.025860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:36.026631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:36.031523 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:36.064182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:36.086115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e5bf95f0-808e-4b0a-9e52-172252c2504a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.307117 May 27 03:35:36.089884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 31/52] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:35 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:36.172391 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:36.186399 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:36.196543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:36.196543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-910fc78e-9817-4af2-934f-4696eb3b7524 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1277 microversion: 2.20 time: 0.202687 May 27 03:35:36.196543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 22/53] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:35 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:37.006530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:37.007331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:37.009484 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:37.014603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:37.015763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:37.015880 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:37.016362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:37.108257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:37.109275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:37.117991 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:37.129000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:37.129747 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:37.130577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:37.131086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:37.137007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b40a0d4a-c36b-49d4-953c-0748dc46e9b0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1302 microversion: 2.1 time: 0.134767 May 27 03:35:37.138662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 32/54] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:37 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1302 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:37.213549 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:37.214488 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:37.230061 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:37.230562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:37.231369 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:37.231802 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:37.350754 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:37.359341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:37.360892 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:37.362013 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0b5f46aa-9ae6-4b4d-b725-586ff026c364 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1341 microversion: 2.20 time: 0.153771 May 27 03:35:37.362578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 33/55] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:37 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:37.381013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:37.388644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ffd482ad-0de9-4b5c-864c-8b93c2604dd4 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.290229 May 27 03:35:37.389234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 23/56] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:37 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:38.155470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:38.157525 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:38.175851 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:38.182471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.183279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.184243 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.184898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.380335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:38.386017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:38.388656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.389398 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.390538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.391235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.674035 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:38.683154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:38.685180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:38.686478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-00160d69-4630-4cc5-9b35-63aa184842ea tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1351 microversion: 2.20 time: 0.310475 May 27 03:35:38.687080 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 24/57] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:38 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1351 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:38.702418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:38.704184 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:38.705841 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:38.711978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1609de2a-9cf0-42d7-af22-72c272df7b3b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.560377 May 27 03:35:38.712999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 34/58] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:38 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:38.723286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.723286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.723286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.723286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.751239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=16 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:38.861618 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:38.863899 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e3a21e44-a9ce-44e6-bb8f-ab1f16cb3685 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.163847 May 27 03:35:38.864481 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 25/59] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:38 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:39.720361 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:39.721541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:39.732679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:39.734575 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:39.741181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:39.741674 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=22 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:39.756089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.756780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.757256 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.759120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.759787 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.762518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.762942 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.765035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.938822 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:39.950872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:39.966518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:39.966518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:39.966518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1da01ffd-e7fa-4f4f-aa70-cecf98dee894 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1339 microversion: 2.20 time: 0.256595 May 27 03:35:39.966826 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 35/60] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:39 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:39.966826 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:39.966826 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:39.973222 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.974628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.975426 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.975856 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:40.139544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:40.155262 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-470f085e-71d8-44f4-95df-35d1a991aaed tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.427446 May 27 03:35:40.167201 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 26/61] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:39 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:40.194998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:40.203143 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-db6ed3e0-4cb1-4cf7-87a3-b51b91c2761e tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.241500 May 27 03:35:40.204258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 36/62] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:39 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:40.978065 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:40.978666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:40.984846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:40.985284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:40.986031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:40.986457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.046316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:41.055544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:41.057243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:41.058350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-36cc8707-465e-4b7d-8947-2db7b52dd37b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1339 microversion: 2.20 time: 0.084693 May 27 03:35:41.058961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 27/63] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:40 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:41.175346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:41.175346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:41.182038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.182750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.183644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.184169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.220735 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:41.221216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:41.232726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.232726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.232726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.232726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.492835 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:41.510157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4c3cbb91-b9f0-4e7f-b818-941193458d96 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.340437 May 27 03:35:41.511314 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 37/64] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:41 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:41.561798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:41.571538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-abdcb940-4ee2-4e53-aca0-e1f666e85757 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.354859 May 27 03:35:41.572118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 28/65] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:41 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:41.676035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-f456cb8a-a4c2-4195-8a4f-21ba983b156b req-32d2c6eb-609d-4e93-8932-f237c344452f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79319ab8-3b21-4189-af20-8295ec40a10b", "tag": "8c6d464a-a05a-418c-93bf-d261bd71e3e9"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:41.689084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-f456cb8a-a4c2-4195-8a4f-21ba983b156b req-32d2c6eb-609d-4e93-8932-f237c344452f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.692478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-f456cb8a-a4c2-4195-8a4f-21ba983b156b req-32d2c6eb-609d-4e93-8932-f237c344452f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.744394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-f456cb8a-a4c2-4195-8a4f-21ba983b156b req-32d2c6eb-609d-4e93-8932-f237c344452f service nova] Creating event network-changed:8c6d464a-a05a-418c-93bf-d261bd71e3e9 for instance 79319ab8-3b21-4189-af20-8295ec40a10b on hv-cinder-82880 May 27 03:35:41.745084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-f456cb8a-a4c2-4195-8a4f-21ba983b156b req-32d2c6eb-609d-4e93-8932-f237c344452f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 03:35:41.746194 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.746628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.747762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.748332 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.759556 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.compute.rpcapi [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 03:35:41.760575 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] Releasing lock "compute-rpcapi-router" {{(pid=124770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 03:35:41.792685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ed683369-e516-4ec4-a297-a408e3bb3fe1 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279691 May 27 03:35:41.794236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 38/66] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:42.077200 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:42.077804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:42.087483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.088012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.088922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.089358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.223523 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:42.232197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:42.233782 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:42.236194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-02e39a08-c8f7-41fb-8267-a7ba058bdf4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.162678 May 27 03:35:42.236194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 29/67] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:42 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:42.528471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:42.529105 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:42.535547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.535999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.537306 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.537739 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.588155 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:42.589393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:42.596688 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.597183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.598193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.598361 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.740778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:42.751260 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f80c2b6e-6c41-48e9-a761-9e6fabef6a3a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.227334 May 27 03:35:42.751841 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 39/68] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:42 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:42.802130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:42.810466 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-61437d0d-7021-4a50-8766-436a02d6d74b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.226171 May 27 03:35:42.811155 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 30/69] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:42 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:43.253983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:43.255792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:43.268145 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.268858 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.269823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.270674 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.498963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:43.522419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:43.524486 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:43.526182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-80d58b6c-34e4-45c8-88d8-e1dc22bff072 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.276536 May 27 03:35:43.527559 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 40/70] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:43 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:43.777149 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:43.778487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:43.788884 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.790139 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.793802 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.794741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.832568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:43.834059 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:43.847423 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.848037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.856574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.856574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:44.139012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:44.145373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e849dc84-3c16-4b01-81fc-8f7b6544c137 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.372561 May 27 03:35:44.154508 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 31/71] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:43 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:44.174388 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:44.183086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b779ef7b-07e4-406e-8d05-80d135a85336 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.355119 May 27 03:35:44.192749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 41/72] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:43 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:44.459946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-470f3501-1994-4dc9-bfa1-ba9fbed15c48 req-b5bc34f7-8f9f-4081-ad23-4af88a9272ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b512bc5-a49b-4745-9fee-f78929ca3611", "name": "network-vif-plugged", "status": "completed", "tag": "96824533-804b-471b-8dd5-0a9fd558c227"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:44.468419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-470f3501-1994-4dc9-bfa1-ba9fbed15c48 req-b5bc34f7-8f9f-4081-ad23-4af88a9272ee service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:44.468867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-470f3501-1994-4dc9-bfa1-ba9fbed15c48 req-b5bc34f7-8f9f-4081-ad23-4af88a9272ee service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:44.485379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-470f3501-1994-4dc9-bfa1-ba9fbed15c48 req-b5bc34f7-8f9f-4081-ad23-4af88a9272ee service nova] Creating event network-vif-plugged:96824533-804b-471b-8dd5-0a9fd558c227 for instance 7b512bc5-a49b-4745-9fee-f78929ca3611 on hv-cinder-82880 May 27 03:35:44.491840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-470f3501-1994-4dc9-bfa1-ba9fbed15c48 req-b5bc34f7-8f9f-4081-ad23-4af88a9272ee service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337816 May 27 03:35:44.492458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 32/73] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:44.546570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:44.547241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:44.561687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:44.562147 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:44.567147 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:44.570311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:44.843796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:44.857403 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:44.858967 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:44.860123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9633a4d3-a13d-4e3d-a6fe-7440f872a1b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.317368 May 27 03:35:44.861265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 42/74] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:44 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:44.921436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-d2c19a41-467c-4ec1-b8ee-2c15b7e60d0e req-b7e3c99e-d0af-4263-a6a1-44647204131f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:44.964147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d2c19a41-467c-4ec1-b8ee-2c15b7e60d0e req-b7e3c99e-d0af-4263-a6a1-44647204131f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:44.966070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d2c19a41-467c-4ec1-b8ee-2c15b7e60d0e req-b7e3c99e-d0af-4263-a6a1-44647204131f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:44.996465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-d2c19a41-467c-4ec1-b8ee-2c15b7e60d0e req-b7e3c99e-d0af-4263-a6a1-44647204131f service nova] Creating event network-changed:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:35:45.002711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-d2c19a41-467c-4ec1-b8ee-2c15b7e60d0e req-b7e3c99e-d0af-4263-a6a1-44647204131f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087981 May 27 03:35:45.003731 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 33/75] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:45.164401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:45.165004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:45.177863 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:45.177863 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:45.178667 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:45.179285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:45.204644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:45.205512 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:45.221119 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:45.222255 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:45.225220 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:45.229466 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:45.472310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:45.475222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:45.488887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4df03906-8365-45b5-926c-3c9bf009a6e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.329159 May 27 03:35:45.491359 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d33fd6a9-3136-4a73-ad4c-c24ecbdaafa6 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.294825 May 27 03:35:45.491952 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 34/76] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:45 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:45.493691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 43/77] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:45 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:45.879173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:45.880870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:45.898554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:45.899452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:45.901066 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:45.901502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:46.053143 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:46.061609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:46.063156 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:46.064315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-db6c50e6-dad6-45a3-a387-b9ef2f34935d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.189209 May 27 03:35:46.079517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 35/78] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:45 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:46.514263 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:46.514945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:46.516429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:46.518026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:46.521374 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:46.521814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:46.522576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:46.523074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:46.533280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:46.542949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:46.543866 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:46.544490 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:46.772369 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:46.785579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-44c56416-74be-4fd6-a916-4328c68e87a1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.275377 May 27 03:35:46.786155 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 44/79] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:46 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:46.807788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:46.817620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-194c8622-b20c-4e68-989b-5b038d46debd tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.306342 May 27 03:35:46.818507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 36/80] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:46 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:47.097718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:47.098420 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:47.104433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:47.105002 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:47.105811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:47.106342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:47.249855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:47.261031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:47.262554 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:47.263812 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4ff79689-e5ea-4252-9c28-80a9c041197c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.170234 May 27 03:35:47.264551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 45/81] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:47 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:47.803665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:47.804277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:47.810776 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:47.811256 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:47.812025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:47.812460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:47.834621 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:47.835705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:47.841466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:47.841926 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:47.842716 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:47.843177 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:48.046420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:48.060912 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9f1a0ec3-3168-48c8-8eff-469379459130 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.259768 May 27 03:35:48.061844 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 37/82] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:47 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:48.096828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:48.105194 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-719a4424-4421-435b-938d-2c08ef709dd7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1313 microversion: 2.1 time: 0.274223 May 27 03:35:48.112989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 46/83] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:47 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:48.284251 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:48.285235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:48.293647 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:48.294248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:48.295184 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:48.295619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:48.454544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:48.463241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:48.464754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:48.465840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-45e14188-9760-4b0e-aa46-104a7dd8d0f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.186432 May 27 03:35:48.466421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 38/84] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:48 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:49.077666 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:49.078273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:49.084744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.085236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.086176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.089817 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.121569 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:49.122165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:49.128535 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.128874 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.129628 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.130071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.134935 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:49.339983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:49.343141 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:49.348428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-42a083f1-2237-42d2-a6a7-dc9da476005a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.274705 May 27 03:35:49.352131 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-064437b4-f331-48e8-82c6-3b61816d1cf1 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1499 microversion: 2.1 time: 0.234287 May 27 03:35:49.352892 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 39/85] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:49 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1499 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:49.359307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 47/86] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:49 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:49.483827 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:49.484807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:49.491486 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.491932 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.492700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.493320 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.642274 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:49.653601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:49.655480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:49.656558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f5d594c0-db62-4644-954c-daa30cc2d6c8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.176625 May 27 03:35:49.657147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 40/87] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:49 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:49.732167 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-51762ff3-6ea0-4989-be54-345ebbbf6dab req-2757c122-511f-4829-8bf7-577deeec9f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79319ab8-3b21-4189-af20-8295ec40a10b", "name": "network-vif-plugged", "status": "completed", "tag": "8c6d464a-a05a-418c-93bf-d261bd71e3e9"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:49.741756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-51762ff3-6ea0-4989-be54-345ebbbf6dab req-2757c122-511f-4829-8bf7-577deeec9f43 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:49.747089 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-51762ff3-6ea0-4989-be54-345ebbbf6dab req-2757c122-511f-4829-8bf7-577deeec9f43 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:49.755988 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-51762ff3-6ea0-4989-be54-345ebbbf6dab req-2757c122-511f-4829-8bf7-577deeec9f43 service nova] Creating event network-vif-plugged:8c6d464a-a05a-418c-93bf-d261bd71e3e9 for instance 79319ab8-3b21-4189-af20-8295ec40a10b on hv-cinder-82880 May 27 03:35:49.761581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-51762ff3-6ea0-4989-be54-345ebbbf6dab req-2757c122-511f-4829-8bf7-577deeec9f43 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033455 May 27 03:35:49.762795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 48/88] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:50.366950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:50.370766 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:50.384988 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:50.385499 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:50.388189 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:50.388751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:50.519842 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:50.527333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-56666fda-8391-4c55-801c-a4eabc8eea66 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.165023 May 27 03:35:50.527905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 41/89] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:50 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:50.677656 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:50.678355 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:50.686004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:50.686456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:50.687234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:50.687671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:50.841192 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:50.850727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:50.852454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:50.853917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5551b02a-999a-49bf-a613-fcf922fa0106 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.182249 May 27 03:35:50.854736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 49/90] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:50 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:51.406215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "437355e8-05dc-49db-b8fb-e4483c2fe1dc"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:51.408363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:51.415656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.416186 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:51.417030 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.417654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:51.549974 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:51.551233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:51.558227 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.559168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:51.560649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.561546 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:51.761871 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:51.770028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:51.773066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ac3f92b0-847b-4316-a5df-bd85de5af82b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.227868 May 27 03:35:51.777246 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 50/91] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:51 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:51.794157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-ae29760b-6634-4dab-9295-e4b41a136777 req-9ec294f9-930f-4228-abcd-c051ce72d98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "name": "network-vif-plugged", "status": "completed", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:51.806577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ae29760b-6634-4dab-9295-e4b41a136777 req-9ec294f9-930f-4228-abcd-c051ce72d98f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.807682 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ae29760b-6634-4dab-9295-e4b41a136777 req-9ec294f9-930f-4228-abcd-c051ce72d98f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:51.833947 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-ae29760b-6634-4dab-9295-e4b41a136777 req-9ec294f9-930f-4228-abcd-c051ce72d98f service nova] Creating event network-vif-plugged:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:35:51.839666 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-ae29760b-6634-4dab-9295-e4b41a136777 req-9ec294f9-930f-4228-abcd-c051ce72d98f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052381 May 27 03:35:51.840362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 51/92] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:35:51.873429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:51.874302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:51.881338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.881737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:51.882491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:51.882957 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:52.075466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:52.084122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:52.085640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:52.086980 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bf248b72-4e04-437a-8c4d-73d994e2f2f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.217686 May 27 03:35:52.088465 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 52/93] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:51 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:52.793285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:52.793884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:52.800330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:52.800772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:52.801510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:52.801972 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:52.952758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:52.961638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d3d08aec-1383-42ed-9509-f8e05f439cc4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.172016 May 27 03:35:52.962384 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 53/94] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:52 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:53.105639 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:53.106310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:53.112643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:53.113159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:53.113996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:53.114530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:53.118887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:53.243148 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:53.254308 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:53.254308 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:53.254308 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ab70a2d6-0bc7-4c3a-a7a4-4bf83699b0d2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.152009 May 27 03:35:53.254637 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 54/95] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:53 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:53.978807 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:53.979496 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:53.985955 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:53.986402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:53.987177 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:53.987613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:54.133712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:54.142812 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-689ad03d-70c9-4abb-b437-7cc56e683b2b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1367 microversion: 2.1 time: 0.167747 May 27 03:35:54.153342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 55/96] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:53 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:54.272006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:54.272624 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:54.279130 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:54.279628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:54.280347 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:54.281082 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:54.410532 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:54.420603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:54.422109 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:54.426881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d5320fca-ebde-439e-9208-f7211528754c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.155183 May 27 03:35:54.426881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 56/97] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:54 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:55.161009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:55.162289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:55.169410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:55.169866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:55.170620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:55.171083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:55.327201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:55.335563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d33902f5-f257-4df5-bc0b-33f3f8fe9d24 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1558 microversion: 2.1 time: 0.178732 May 27 03:35:55.336464 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 57/98] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:35:55 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:55.352172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:55.352661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:55.358690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:55.359176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:55.359939 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:55.360376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:55.476304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e5363b1b-7112-462d-b490-e78d039e9657 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127892 May 27 03:35:55.477016 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 58/99] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:35:55 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:35:55.481552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:55.482155 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:55.488616 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:55.489060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:55.490409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:55.490861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:55.800378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:55.808409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:55.810021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:55.811275 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e032a83c-71dc-429c-88d6-78ae4daf096e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.333386 May 27 03:35:55.811922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 59/100] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:55 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:56.829572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:56.830187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:56.836699 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:56.837155 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:56.837945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:56.838383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:57.027523 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:57.036793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:57.041940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:57.044591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3eec3f05-b6fe-460b-a23b-4e98a2a3be48 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.218877 May 27 03:35:57.045352 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 60/101] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:56 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:57.063051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-c6b7f83b-02b0-4c4a-8f55-67ce91ae2bc8 req-166f4174-3e79-4d58-9974-1db9c999bb2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79319ab8-3b21-4189-af20-8295ec40a10b", "tag": "8c6d464a-a05a-418c-93bf-d261bd71e3e9"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:57.088329 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-c6b7f83b-02b0-4c4a-8f55-67ce91ae2bc8 req-166f4174-3e79-4d58-9974-1db9c999bb2c service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:57.088783 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-c6b7f83b-02b0-4c4a-8f55-67ce91ae2bc8 req-166f4174-3e79-4d58-9974-1db9c999bb2c service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:57.253697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-c6b7f83b-02b0-4c4a-8f55-67ce91ae2bc8 req-166f4174-3e79-4d58-9974-1db9c999bb2c service nova] Creating event network-changed:8c6d464a-a05a-418c-93bf-d261bd71e3e9 for instance 79319ab8-3b21-4189-af20-8295ec40a10b on hv-cinder-82880 May 27 03:35:57.253697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-c6b7f83b-02b0-4c4a-8f55-67ce91ae2bc8 req-166f4174-3e79-4d58-9974-1db9c999bb2c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205054 May 27 03:35:57.255268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 61/102] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:57.606555 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-239fc32b-c7b5-41d3-ba4c-208abb033df9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "POST /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.205329 May 27 03:35:57.607646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 42/103] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:35:51 2022] POST /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611/os-volume_attachments => generated 194 bytes in 6207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:58.064978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:58.065777 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:58.072705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:58.073162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:58.073927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:58.074411 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:58.206447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:58.214402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:58.216387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:58.217033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d775c4db-9409-4dfb-8109-18dee8ca39f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.156586 May 27 03:35:58.217597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 62/104] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:58 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:59.236471 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:59.237158 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:59.244035 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:59.244476 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:59.245229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:59.245676 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:59.374947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:59.382704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:59.384254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:59.385347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-18a8b2ba-380c-4333-b4c8-1191baedb284 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.153599 May 27 03:35:59.385909 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 43/105] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:35:59 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:36:00.404090 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:00.404704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:00.410894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:00.411384 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:00.412685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:00.413121 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:00.543586 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:00.551888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:00.554067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:00.555190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-26c6c205-ce01-4be0-a990-3cdfb6b439c0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.154990 May 27 03:36:00.555749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 63/106] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:36:00 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:36:01.573434 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:01.573986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:01.581378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:01.581826 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:01.582707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:01.583686 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:01.732263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:01.740526 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:01.742043 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:01.743187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d4be8c83-ff09-4faa-8471-4400962398c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.173640 May 27 03:36:01.743759 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 44/107] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:36:01 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:36:02.761565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:02.762165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:02.768205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:02.768649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:02.769391 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:02.769843 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:02.896869 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:02.905001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:02.907589 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:02.907859 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ee5614af-3930-46a8-8454-9551ddc8e51a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1407 microversion: 2.20 time: 0.150108 May 27 03:36:02.908258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 64/108] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:36:02 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:36:03.925601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:03.926126 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:03.932713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:03.933168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:03.933933 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:03.934373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:04.065470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:04.078447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:04.080010 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:04.081177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8d3dcfa4-a0d0-46ff-a8a9-f63b6a58ae3f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1599 microversion: 2.20 time: 0.159549 May 27 03:36:04.081814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 45/109] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:36:03 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:36:04.102046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:04.102560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:04.108562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:04.109058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:04.109803 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:04.110229 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:04.186500 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-80133e2a-1760-4ddb-8150-c6877d48e4f7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088897 May 27 03:36:04.187127 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 65/110] 10.222.0.24 () {60 vars in 1315 bytes} [Fri May 27 03:36:04 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:36:05.257972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-c40b79ec-55f5-4d8b-8e0f-9b700779041e req-27161d54-b61c-4570-89d4-0cefc149910f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:05.266558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c40b79ec-55f5-4d8b-8e0f-9b700779041e req-27161d54-b61c-4570-89d4-0cefc149910f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:05.267145 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c40b79ec-55f5-4d8b-8e0f-9b700779041e req-27161d54-b61c-4570-89d4-0cefc149910f service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:05.278544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-c40b79ec-55f5-4d8b-8e0f-9b700779041e req-27161d54-b61c-4570-89d4-0cefc149910f service nova] Creating event network-changed:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:36:05.283677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-c40b79ec-55f5-4d8b-8e0f-9b700779041e req-27161d54-b61c-4570-89d4-0cefc149910f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029436 May 27 03:36:05.284510 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 46/111] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:15.975297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=67 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:15.976048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=62 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:15.982445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:15.982445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:15.986651 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.987120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.987891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.988316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.013639 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:36:16.319167 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ceabd74c-73a7-4dc2-8c1a-1e2ee6dab2fa tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 204 len: 0 microversion: 2.1 time: 0.344611 May 27 03:36:16.319763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 66/112] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:36:15 2022] DELETE /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:36:16.328410 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:16.329864 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:16.331643 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=51 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:16.332314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:16.337243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.337691 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.338452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.338953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.665087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:16.672977 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7c501e6d-85f8-4d8d-94e8-e3e5ecec6ce7 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1551 microversion: 2.1 time: 0.348974 May 27 03:36:16.673554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 47/113] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:16 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1551 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:17.690042 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:17.690741 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:17.697363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.697815 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.698575 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.699042 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.824563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:17.832875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a7aa9de9-19ba-40d2-9fd4-ecff7473d541 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1551 microversion: 2.1 time: 0.147071 May 27 03:36:17.833530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 67/114] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:17 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:18.849387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:18.849992 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:18.856463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:18.856909 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:18.857656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:18.858119 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:18.990434 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:18.998861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-28e64da4-73a3-44f7-8719-2f1b5ed5b710 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1551 microversion: 2.1 time: 0.153291 May 27 03:36:18.999427 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 48/115] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:18 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:20.019312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:20.019916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:20.027078 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:20.027522 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:20.028284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:20.030875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:20.196254 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:20.204583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1200d66a-4be0-4596-b730-a72a2119ac08 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1551 microversion: 2.1 time: 0.189120 May 27 03:36:20.205153 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 68/116] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:20 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1551 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:21.221181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:21.221930 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:21.229430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:21.229876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:21.230694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:21.231148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:21.502595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:21.510615 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-31d93968-768c-4683-883c-95a2996726d9 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1551 microversion: 2.1 time: 0.293235 May 27 03:36:21.511214 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 49/117] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:21 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1551 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:21.995641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-27a2c7e4-175a-4a1e-869e-82e8363294d9 req-605be28c-5fd4-41a1-96d8-0ef3b1d35745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b512bc5-a49b-4745-9fee-f78929ca3611", "name": "network-vif-deleted", "tag": "96824533-804b-471b-8dd5-0a9fd558c227"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:22.004292 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-27a2c7e4-175a-4a1e-869e-82e8363294d9 req-605be28c-5fd4-41a1-96d8-0ef3b1d35745 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:22.004727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-27a2c7e4-175a-4a1e-869e-82e8363294d9 req-605be28c-5fd4-41a1-96d8-0ef3b1d35745 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:22.016923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-27a2c7e4-175a-4a1e-869e-82e8363294d9 req-605be28c-5fd4-41a1-96d8-0ef3b1d35745 service nova] Creating event network-vif-deleted:96824533-804b-471b-8dd5-0a9fd558c227 for instance 7b512bc5-a49b-4745-9fee-f78929ca3611 on hv-cinder-82880 May 27 03:36:22.022665 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-27a2c7e4-175a-4a1e-869e-82e8363294d9 req-605be28c-5fd4-41a1-96d8-0ef3b1d35745 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 May 27 03:36:22.023396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 69/118] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:22.527949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:22.528666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:22.534954 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:22.535408 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:22.536194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:22.536609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:22.604106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:22.612159 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6e696120-a966-483b-8f37-f29b995d7529 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1509 microversion: 2.1 time: 0.088180 May 27 03:36:22.612741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 50/119] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:22 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1509 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:23.630178 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:23.630904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:23.637749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:23.638195 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:23.639228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:23.639830 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:23.712530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:23.720895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a6a51157-d575-4df7-af0c-61f5845d23e3 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1509 microversion: 2.1 time: 0.095126 May 27 03:36:23.721465 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 70/120] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:23 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:24.740340 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:24.742264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:24.750572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:24.751227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:24.752311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:24.752883 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:24.834465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:24.843070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e4bec15b-17ef-474d-bcfb-96eb9b53e78a tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1344 microversion: 2.1 time: 0.109054 May 27 03:36:24.843649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 51/121] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:24 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:25.866723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:25.866723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:25.869169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:25.869623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:25.870397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:25.870879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:25.915393 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:25.915918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:25.916572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lazy-loading 'fault' on Instance uuid 7b512bc5-a49b-4745-9fee-f78929ca3611 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:36:25.987283 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8584a3f99b0144979f69536f7cc86851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b236cd8e9049e6acdeb545f5d3382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:26.004966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-daa0f90b-0df7-4ea1-81b1-46e14c819a7d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 200 len: 1349 microversion: 2.1 time: 0.147069 May 27 03:36:26.010872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 71/122] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:25 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 1349 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:27.032711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:27.032711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:27.036089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:27.036621 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:27.037654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:27.038717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:27.062616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] HTTP exception thrown: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Request method failure captured: May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 HTTP/1.1 May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEbt9nhwJbvvoDHuEISUCYl7FpMCpg0efkfzIzajZOgs9kN_liIvQ2NJbmc9ezOGNp2iNAL3CgzCIcvF2onTwn38Q3FcoeDRdSPwMbryApoDLRv0eRXxtiR8Te8JdNiCKGmugHTP6uDI4TPvr-HZ5RZiHzdvkQUsrYYYjDhEgDqNKPs May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:36:27.067698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e3b236cd8e9049e6acdeb545f5d3382d", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e3b236cd8e9049e6acdeb545f5d3382d"}]}] May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-DeleteServersTestJSON-903556100 May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 8584a3f99b0144979f69536f7cc86851 May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.069130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '7b512bc5-a49b-4745-9fee-f78929ca3611'} May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:27.069754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.070871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:27.071870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Returning 404 to user: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:27.071870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-13c3f922-6f81-4a76-8183-d0ec67d7528b tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 404 len: 111 microversion: 2.1 time: 0.049308 May 27 03:36:27.071870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 52/123] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:27 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:36:27.228161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:27.229892 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:27.237163 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:27.237784 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:27.238716 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:27.239375 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:27.255896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] HTTP exception thrown: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Request method failure captured: May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611/os-volume_attachments HTTP/1.1 May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbt9nhwJbvvoDHuEISUCYl7FpMCpg0efkfzIzajZOgs9kN_liIvQ2NJbmc9ezOGNp2iNAL3CgzCIcvF2onTwn38Q3FcoeDRdSPwMbryApoDLRv0eRXxtiR8Te8JdNiCKGmugHTP6uDI4TPvr-HZ5RZiHzdvkQUsrYYYjDhEgDqNKPs May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:36:27.260343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e3b236cd8e9049e6acdeb545f5d3382d", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e3b236cd8e9049e6acdeb545f5d3382d"}]}] May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-DeleteServersTestJSON-903556100 May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 8584a3f99b0144979f69536f7cc86851 May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.261640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'server_id': '7b512bc5-a49b-4745-9fee-f78929ca3611'} May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:27.262410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:27.274321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:27.276006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Returning 404 to user: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:27.276006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dc290caf-05e2-407f-9ceb-a2c350b7c084 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039459 May 27 03:36:27.276006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 72/124] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:36:27 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:36:31.964021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:31.964512 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:31.972828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:31.981125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:31.981125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:31.981125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:31.994825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] HTTP exception thrown: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Request method failure captured: May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 HTTP/1.1 May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEbt9nhwJbvvoDHuEISUCYl7FpMCpg0efkfzIzajZOgs9kN_liIvQ2NJbmc9ezOGNp2iNAL3CgzCIcvF2onTwn38Q3FcoeDRdSPwMbryApoDLRv0eRXxtiR8Te8JdNiCKGmugHTP6uDI4TPvr-HZ5RZiHzdvkQUsrYYYjDhEgDqNKPs May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:36:31.996680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e3b236cd8e9049e6acdeb545f5d3382d", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e3b236cd8e9049e6acdeb545f5d3382d"}]}] May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-DeleteServersTestJSON-903556100 May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 8584a3f99b0144979f69536f7cc86851 May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:31.997814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '7b512bc5-a49b-4745-9fee-f78929ca3611'} May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:31.998464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:31.999975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:36:32.001911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Returning 404 to user: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:32.001911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9083d413-39b1-4784-ba39-ee6285264f33 tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 404 len: 111 microversion: 2.1 time: 0.038742 May 27 03:36:32.001911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 53/125] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:36:31 2022] DELETE /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:36:32.010249 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:32.010249 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] [instance: 7b512bc5-a49b-4745-9fee-f78929ca3611] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:32.014463 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:32.014942 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:32.016367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:32.016842 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:32.036513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] HTTP exception thrown: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Request method failure captured: May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 HTTP/1.1 May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEbt9nhwJbvvoDHuEISUCYl7FpMCpg0efkfzIzajZOgs9kN_liIvQ2NJbmc9ezOGNp2iNAL3CgzCIcvF2onTwn38Q3FcoeDRdSPwMbryApoDLRv0eRXxtiR8Te8JdNiCKGmugHTP6uDI4TPvr-HZ5RZiHzdvkQUsrYYYjDhEgDqNKPs May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:36:32.038790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e3b236cd8e9049e6acdeb545f5d3382d", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e3b236cd8e9049e6acdeb545f5d3382d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e3b236cd8e9049e6acdeb545f5d3382d"}]}] May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-DeleteServersTestJSON-903556100 May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: e3b236cd8e9049e6acdeb545f5d3382d May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-DeleteServersTestJSON-903556100 May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 8584a3f99b0144979f69536f7cc86851 May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-DeleteServersTestJSON-903556100-project May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:32.039954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '7b512bc5-a49b-4745-9fee-f78929ca3611'} May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:32.040664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. May 27 03:36:32.041671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:36:32.042613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] Returning 404 to user: Instance 7b512bc5-a49b-4745-9fee-f78929ca3611 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:32.042613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9cdd6ff5-03ee-4479-a826-20f7e93ca69d tempest-DeleteServersTestJSON-903556100 tempest-DeleteServersTestJSON-903556100-project] 10.222.0.24 "GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611" status: 404 len: 111 microversion: 2.1 time: 0.037647 May 27 03:36:32.042613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 73/126] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:32 2022] GET /compute/v2.1/servers/7b512bc5-a49b-4745-9fee-f78929ca3611 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:36:42.003634 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=14 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:42.004384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=34 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:42.275024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1934058564", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:44.125024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:44.126485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:44.132913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:44.134280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:44.136028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:44.136642 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:44.137629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:44.140796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:44.174985 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-41ca42d4-5ef1-4940-a669-23511ecf2f38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/ips" status: 200 len: 150 microversion: 2.1 time: 0.055766 May 27 03:36:44.178119 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 74/127] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:36:44 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:46.182321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "545624ea-8813-4f0f-9729-0752e8ba9cde"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:46.183537 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:46.197146 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:46.199627 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:46.199627 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:46.199627 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:46.360232 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] validate_networks() for [('7ad434bf-5110-4909-8d4e-fd9ddb1876ab', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:36:47.071319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:36:47.090016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:36:47.091746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:36:47.092160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:36:47.094974 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:36:47.109743 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:47.110195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:47.111031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:47.111468 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:47.133079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for project 03b1335715234895a0c1a555b22ee8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:36:47.138061 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for user b2671aaae84644acb89c3c3595bb5673 and project 03b1335715234895a0c1a555b22ee8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:36:47.151360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:36:47.153636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:36:47.350272 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cf6d6db7-4c94-4b95-9593-8f9c95759ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.351605 May 27 03:36:47.353870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 54/128] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:36:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 5356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:36:47.362919 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5f6e6f67-bb0d-4217-80a2-a4b47572fd9b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:47.363537 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5f6e6f67-bb0d-4217-80a2-a4b47572fd9b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:47.387438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4c4ef388-9df4-4ce7-bb42-72e7e7605667 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215256 May 27 03:36:47.390674 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 75/129] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:36:46 2022] POST /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 194 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:36:47.433435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5f6e6f67-bb0d-4217-80a2-a4b47572fd9b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:47.441593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5f6e6f67-bb0d-4217-80a2-a4b47572fd9b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1222 microversion: 2.1 time: 0.082806 May 27 03:36:47.442866 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 55/130] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:47 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:47.637709 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1332697439", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:47.713958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] validate_networks() for [('7ad434bf-5110-4909-8d4e-fd9ddb1876ab', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:36:48.166099 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:36:48.166860 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:36:48.167580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:36:48.168303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:36:48.169074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:36:48.180529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:48.181242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:48.182242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:48.182877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:48.208128 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for project 03b1335715234895a0c1a555b22ee8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:36:48.213521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for user b2671aaae84644acb89c3c3595bb5673 and project 03b1335715234895a0c1a555b22ee8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:36:48.227694 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:36:48.231200 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:36:48.396683 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9990ba2b-3bcc-4942-a89e-0d74742da935 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.767586 May 27 03:36:48.398651 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 76/131] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:36:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:36:48.408641 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8d6e69ba-ab09-4602-8c58-e768c03ac977 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:48.409260 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8d6e69ba-ab09-4602-8c58-e768c03ac977 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:48.481060 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8d6e69ba-ab09-4602-8c58-e768c03ac977 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:48.490269 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8d6e69ba-ab09-4602-8c58-e768c03ac977 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1222 microversion: 2.1 time: 0.085595 May 27 03:36:48.500691 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 56/132] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:48 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:49.508680 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0656786a-c07d-480c-ac2c-00e797460bf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:49.509936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0656786a-c07d-480c-ac2c-00e797460bf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:49.575120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0656786a-c07d-480c-ac2c-00e797460bf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:49.585716 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0656786a-c07d-480c-ac2c-00e797460bf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1222 microversion: 2.1 time: 0.081544 May 27 03:36:49.590352 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 77/133] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:49 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:50.607755 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:50.609027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:50.617258 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:50.618037 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:50.619076 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:50.619768 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:50.702045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:50.708216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d57f2a24-fda4-4fb3-9a67-3126e00060dc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1274 microversion: 2.1 time: 0.105894 May 27 03:36:50.708795 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 57/134] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:50 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:51.727560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:51.729415 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:51.745536 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:51.746772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:51.748144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:51.751030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:51.850588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:51.859896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0afb0eba-ec61-4277-a0e3-b6eb5c20dfe5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1280 microversion: 2.1 time: 0.138309 May 27 03:36:51.870457 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 78/135] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:51 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1280 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:52.877508 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:52.878181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:52.887388 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:52.887851 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:52.888625 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:52.889099 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:53.166679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:53.177939 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8f40b371-0e6e-4ebc-b1d4-42ccc10f3e18 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.304558 May 27 03:36:53.181916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 58/136] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:52 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:54.206447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:54.206447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:54.208770 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:54.209968 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:54.211154 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:54.211841 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:54.525277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:54.534357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3d30d8a1-da72-4827-ac1e-201f0c32ffad tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.339045 May 27 03:36:54.537306 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 79/137] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:54 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:54.616083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-db74f727-1cf9-4792-8f0a-aa420d1459b5 req-eb919b45-5ade-4cc4-a4e9-c980e8960818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822", "tag": "ca04734c-9ae1-421c-83aa-9ede7ab3af1a"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:54.660807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-db74f727-1cf9-4792-8f0a-aa420d1459b5 req-eb919b45-5ade-4cc4-a4e9-c980e8960818 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:54.660807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-db74f727-1cf9-4792-8f0a-aa420d1459b5 req-eb919b45-5ade-4cc4-a4e9-c980e8960818 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:54.718677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-db74f727-1cf9-4792-8f0a-aa420d1459b5 req-eb919b45-5ade-4cc4-a4e9-c980e8960818 service nova] Creating event network-changed:ca04734c-9ae1-421c-83aa-9ede7ab3af1a for instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 on hv-cinder-82880 May 27 03:36:54.723694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-db74f727-1cf9-4792-8f0a-aa420d1459b5 req-eb919b45-5ade-4cc4-a4e9-c980e8960818 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127211 May 27 03:36:54.724989 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 59/138] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:55.551321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:55.551936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:55.574465 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:55.577411 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:55.578413 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:55.579064 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:55.752879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:55.760621 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c043f93c-361f-4193-8cb4-8c3bffa84b4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.213089 May 27 03:36:55.761448 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 80/139] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:55 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:56.164399 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-63b4c6dc-ffc3-4a80-a47d-54f7a15d1c8e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: .version_select at 0x7f3046940b80>, body: {"keypair": {"name": "tempest-keypair-716719997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfn0eEl/1Jw9qhrrZzfwtEMmA/J76FiSmEf0mGkE4J6uv3GlXAJVV9lt3Yl0CC34LgbDXSExKmXPiM4B0LE1ah6kLW3IBHDRuVtgX6yd0BDvjVExzs2Nk3lRuzQw9+Qew=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:56.189554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-63b4c6dc-ffc3-4a80-a47d-54f7a15d1c8e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:36:56.195455 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-63b4c6dc-ffc3-4a80-a47d-54f7a15d1c8e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:36:56.353035 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-63b4c6dc-ffc3-4a80-a47d-54f7a15d1c8e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199192 May 27 03:36:56.353653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 60/140] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:36:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:56.745268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-dbb56ee2-d2d0-4f7e-80d9-96917af6311d req-a998b44a-d3b0-4bb5-8e45-747446f4f229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94909255-c0eb-42c8-86f4-d3622d539f0c", "tag": "0b783256-36f5-4ea7-b360-d6d1ff32af14"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:56.754001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-dbb56ee2-d2d0-4f7e-80d9-96917af6311d req-a998b44a-d3b0-4bb5-8e45-747446f4f229 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:56.754395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-dbb56ee2-d2d0-4f7e-80d9-96917af6311d req-a998b44a-d3b0-4bb5-8e45-747446f4f229 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:56.768209 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-dbb56ee2-d2d0-4f7e-80d9-96917af6311d req-a998b44a-d3b0-4bb5-8e45-747446f4f229 service nova] Creating event network-changed:0b783256-36f5-4ea7-b360-d6d1ff32af14 for instance 94909255-c0eb-42c8-86f4-d3622d539f0c on hv-cinder-82880 May 27 03:36:56.771768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-dbb56ee2-d2d0-4f7e-80d9-96917af6311d req-a998b44a-d3b0-4bb5-8e45-747446f4f229 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030085 May 27 03:36:56.772516 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 81/141] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:56.777390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:56.778136 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:56.784380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:56.784846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:56.785758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:56.786072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:56.937850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:56.946143 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-24daac88-d346-465a-93a1-d5ed8e06e293 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.172352 May 27 03:36:56.946945 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 61/142] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:56 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:57.967157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:57.967945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:57.995110 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:57.998782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:58.000919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:58.001382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:58.194321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:58.445082 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:58.456054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4e178693-d373-4153-b8bc-9de3056a8cfd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.496063 May 27 03:36:58.456921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 82/143] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:57 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:59.475552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:59.477163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:59.484541 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:59.488219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:59.489397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:59.491590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:59.492279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:00.035926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:00.045289 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3c069a0d-ab70-45e8-96cf-caf1973eff09 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.574746 May 27 03:37:00.046727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 62/144] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:36:59 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:00.437873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:00.438418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:00.442883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=8 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:00.449694 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:00.450660 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:00.452031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:00.452620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:00.486206 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a4b5d3f7-92f0-4cb1-812b-77033b349b59 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/ips" status: 200 len: 152 microversion: 2.20 time: 0.052868 May 27 03:37:00.493173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 83/145] 10.222.0.24 () {60 vars in 1288 bytes} [Fri May 27 03:37:00 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/ips => generated 152 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:37:01.064497 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:01.065103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:01.074106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:01.074576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:01.076666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:01.097368 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:01.215382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-361395789", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24e2e56a-4202-49e3-9751-4bcdb4e8a6ed"}], "security_groups": [{"name": "tempest-securitygroup--1706458599"}], "key_name": "tempest-keypair-716719997", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:01.463259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] validate_networks() for [('24e2e56a-4202-49e3-9751-4bcdb4e8a6ed', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:37:01.623413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:01.631248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e88ff2bf-b4b3-464a-81af-4de9707c4ca1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.571813 May 27 03:37:01.632430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 63/146] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:01 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:02.608151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:37:02.609476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:37:02.610290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:37:02.610940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:37:02.611644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:37:02.630378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:02.631470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:02.635185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:02.635782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:02.649830 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:02.651244 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:02.661883 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:02.663356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:02.665789 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:02.668629 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:02.681837 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:37:02.703614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:37:02.713578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:37:02.732431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:37:02.865161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c1ac793f-dec8-450c-a98f-0c16e3c43b6d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.655725 May 27 03:37:02.866726 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 84/147] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:37:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:37:02.878490 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-deb483e3-5db8-449b-ba4c-d0b37ef1b012 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:02.878490 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-deb483e3-5db8-449b-ba4c-d0b37ef1b012 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:03.043664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-deb483e3-5db8-449b-ba4c-d0b37ef1b012 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:03.062749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-deb483e3-5db8-449b-ba4c-d0b37ef1b012 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1240 microversion: 2.1 time: 0.190238 May 27 03:37:03.063371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 85/148] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:02 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1240 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:03.094125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:03.094923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:03.102764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:03.103430 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:03.104365 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:03.105122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:03.133913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lazy-loading 'flavor' on Instance uuid c0670a31-c2d9-43c0-85a8-e15e7513a629 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:37:03.224458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:03.236031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3eb3ee43-32fd-437b-8ebc-f018e8adebc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.590903 May 27 03:37:03.241315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 64/149] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:02 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:04.089213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:04.090573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:04.114579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.115959 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.117622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.118350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.177068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-72aebf8b-f9f2-4064-ae6a-3c87004bac38 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/action" status: 202 len: 0 microversion: 2.20 time: 1.098838 May 27 03:37:04.182965 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 86/150] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 27 03:37:03 2022] POST /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/action => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:37:04.191853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:04.192558 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:04.202780 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.203376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.204175 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.204617 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.298933 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:04.317484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c1997c79-e466-4f66-b7f6-a07b5d686e75 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1244 microversion: 2.1 time: 0.223106 May 27 03:37:04.317484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 65/151] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:04 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1244 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:04.317484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:04.317484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:04.324883 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.338579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.340660 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.341121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.599449 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:04.635251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:04.647216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:04.648414 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:04.653054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b7f452f0-211a-4dca-9192-b88837969b17 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.465645 May 27 03:37:04.665357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aaab12ff-14e2-4df6-8102-31080c7b9448 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.354267 May 27 03:37:04.665953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 66/152] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:04 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:04.672248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-d4756572-7fb7-4762-b519-8ac92bf7c4e4 req-01f36b0c-248a-4997-ad4e-29aec1c27d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822", "name": "network-vif-plugged", "status": "completed", "tag": "ca04734c-9ae1-421c-83aa-9ede7ab3af1a"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:04.672456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 87/153] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:04 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:04.696616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d4756572-7fb7-4762-b519-8ac92bf7c4e4 req-01f36b0c-248a-4997-ad4e-29aec1c27d42 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:04.697300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d4756572-7fb7-4762-b519-8ac92bf7c4e4 req-01f36b0c-248a-4997-ad4e-29aec1c27d42 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:04.715612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-d4756572-7fb7-4762-b519-8ac92bf7c4e4 req-01f36b0c-248a-4997-ad4e-29aec1c27d42 service nova] Creating event network-vif-plugged:ca04734c-9ae1-421c-83aa-9ede7ab3af1a for instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 on hv-cinder-82880 May 27 03:37:04.721283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-d4756572-7fb7-4762-b519-8ac92bf7c4e4 req-01f36b0c-248a-4997-ad4e-29aec1c27d42 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053990 May 27 03:37:04.723122 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 67/154] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:05.326482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:05.327307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:05.337971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:05.338690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:05.339786 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:05.340089 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:05.442887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:05.456348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7d055efd-840b-4b5f-8fb4-bb567f7fff5d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1292 microversion: 2.1 time: 0.133103 May 27 03:37:05.458748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 88/155] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:05 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1292 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:05.571296 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-326da58f-4549-47bc-8878-78eb892902ca tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Action: 'create', calling method: .version_select at 0x7f3046a785e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2016079672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4jVEq2P9k+VQCXuZyV+PFz9Db6QwXip84gw5Zr6HQhAye6B++zzwn4FkyxIPAOS9Vsqx9tVkiV2WY9D4Q8j6sAtLi6gQl0TxV/xb1GyeX5prdhJaQABjh020u2YdLi1w=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:05.585819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-326da58f-4549-47bc-8878-78eb892902ca tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Getting quotas for project 19592ab2e5e04d7c952aebf73f4fca6e. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:37:05.589955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-326da58f-4549-47bc-8878-78eb892902ca tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Getting quotas for user 9001a4b10d544226b3b1453b06883db4 and project 19592ab2e5e04d7c952aebf73f4fca6e. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:37:05.667234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-326da58f-4549-47bc-8878-78eb892902ca tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.316716 May 27 03:37:05.667845 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 68/156] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:37:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:37:05.680508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:05.681397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:05.686128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:05.688370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:05.689062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:05.690045 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:05.690687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:05.699050 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:05.707428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:05.707875 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:05.708644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:05.709207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:05.916857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:05.924608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:05.925691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:05.927272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:05.929986 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8f31547f-d2fa-4927-b394-94ac561ef999 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.253609 May 27 03:37:05.931033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 89/157] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:05 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:05.946551 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d294be48-1b02-482c-9976-b88caba96771 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.264903 May 27 03:37:05.947232 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 69/158] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:05 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:06.482526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:06.482526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:06.492107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:06.493115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:06.493888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:06.494328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:06.562123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:06.583370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d0a7ad0b-54c6-4fd6-8eba-d4d7beabea5b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1292 microversion: 2.1 time: 0.112245 May 27 03:37:06.583981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 90/159] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:06 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:06.949387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:06.950695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:06.964322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:06.965191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:06.970215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:06.971266 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:06.972270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:06.972906 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:06.975863 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:06.976338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:06.978099 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:06.979513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:07.194717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:07.203652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:07.209184 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:07.214432 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7121fca0-5a69-44f2-9833-55e47f441377 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.268903 May 27 03:37:07.219100 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 70/160] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:06 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:07.269413 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:07.273028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:07.281367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-44cbcc2d-f410-4a19-ad0a-f7907668ac4e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.320992 May 27 03:37:07.282444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 91/161] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:06 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:07.607230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:07.608182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:07.614660 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:07.615250 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:07.616204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:07.616786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:07.684494 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:07.695609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9f1560aa-98d6-4fb0-91e3-3d199ed4bb49 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1292 microversion: 2.1 time: 0.093953 May 27 03:37:07.704772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 71/162] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:07 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:08.243294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:08.244827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:08.252214 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:08.253048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:08.253942 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:08.254689 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:08.299388 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:08.300814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:08.326029 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:08.326491 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:08.327577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:08.333426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:08.684061 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:08.696630 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:08.712401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:08.713666 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b1e91bb9-62cd-43ad-a3e8-4969569c4c4f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.483057 May 27 03:37:08.719509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 92/163] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:08 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:08.735698 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:08.737994 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:08.755177 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:08.755635 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:08.761462 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:08.762772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:08.816996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:08.834356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6a46eb30-2030-4ea7-8f8a-b5592c119594 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.530409 May 27 03:37:08.837626 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 72/164] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:08 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:08.879676 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:08.890130 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b4893fce-8d5b-410b-b584-736457138a34 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1300 microversion: 2.1 time: 0.169335 May 27 03:37:08.892847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 93/165] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:08 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:09.156215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-d4a37635-44da-4459-854c-eba64cd8ca38 req-53ced837-c83b-4f51-9069-5f56f7cfa2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94909255-c0eb-42c8-86f4-d3622d539f0c", "name": "network-vif-plugged", "status": "completed", "tag": "0b783256-36f5-4ea7-b360-d6d1ff32af14"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:09.181393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d4a37635-44da-4459-854c-eba64cd8ca38 req-53ced837-c83b-4f51-9069-5f56f7cfa2e0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:09.181393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d4a37635-44da-4459-854c-eba64cd8ca38 req-53ced837-c83b-4f51-9069-5f56f7cfa2e0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:09.183773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-d4a37635-44da-4459-854c-eba64cd8ca38 req-53ced837-c83b-4f51-9069-5f56f7cfa2e0 service nova] Creating event network-vif-plugged:0b783256-36f5-4ea7-b360-d6d1ff32af14 for instance 94909255-c0eb-42c8-86f4-d3622d539f0c on hv-cinder-82880 May 27 03:37:09.189093 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-d4a37635-44da-4459-854c-eba64cd8ca38 req-53ced837-c83b-4f51-9069-5f56f7cfa2e0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 May 27 03:37:09.190336 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 73/166] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:09.735417 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:09.736029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:09.750684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:09.752009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:09.757542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:09.762186 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:09.856388 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:09.860075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:09.868895 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:09.869884 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:09.871369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:09.872733 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:10.132455 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:10.141435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:10.143384 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:10.144847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2f571745-15e4-4308-b7c5-65e0aa62595a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.413810 May 27 03:37:10.145383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 94/167] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:09 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:10.150987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:10.151782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:10.158257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:10.158708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:10.158815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:10.159517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:10.159981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:10.166638 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ccca9043-fc35-485a-a89f-c6ccfa1e1bb0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.318893 May 27 03:37:10.167254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 74/168] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:09 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:10.221665 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:10.229490 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-49b52578-a6cb-49d4-9daf-8c263bde3c9d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1298 microversion: 2.1 time: 0.082884 May 27 03:37:10.230052 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 95/169] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:10 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:11.169044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:11.171968 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:11.185444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:11.186067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:11.197701 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:11.198400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:11.200034 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:11.200918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:11.208916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:11.214691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:11.215622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:11.216074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:11.426014 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:11.439173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9ec126ec-8c1b-406d-9b0b-1cb7133b0cee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1322 microversion: 2.1 time: 0.257614 May 27 03:37:11.446876 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 96/170] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:11 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:11.447385 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:11.456356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:11.468513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:11.468693 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:11.469738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5da4c851-b52d-4ac0-9c46-fc041d603aaa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.309788 May 27 03:37:11.470313 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 75/171] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:11 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:11.476272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:11.504904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:11.507931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:11.509107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:11.509767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:11.748126 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:11.760908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4cb39c9f-83d0-4905-a6a2-2c280ceaa4c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.316259 May 27 03:37:11.775029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 97/172] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:11 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:11.995630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-80ce0ace-7fc7-4a08-9caf-75092fd48031 req-aeb4c990-a354-4a4c-a126-a3afd66a7111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1", "tag": "56827ab0-a142-44a1-9dc8-40a1076ef828"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:12.010084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-80ce0ace-7fc7-4a08-9caf-75092fd48031 req-aeb4c990-a354-4a4c-a126-a3afd66a7111 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.010862 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-80ce0ace-7fc7-4a08-9caf-75092fd48031 req-aeb4c990-a354-4a4c-a126-a3afd66a7111 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.035275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-80ce0ace-7fc7-4a08-9caf-75092fd48031 req-aeb4c990-a354-4a4c-a126-a3afd66a7111 service nova] Creating event network-changed:56827ab0-a142-44a1-9dc8-40a1076ef828 for instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 on hv-cinder-82880 May 27 03:37:12.044531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-80ce0ace-7fc7-4a08-9caf-75092fd48031 req-aeb4c990-a354-4a4c-a126-a3afd66a7111 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055073 May 27 03:37:12.045505 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 76/173] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:12.457267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:12.457877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:12.465645 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.466094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.467017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.467771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.491110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:12.492484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:12.500146 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.500715 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.501552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.502062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.662203 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:12.714595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:12.726357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-69ecc9b5-bf29-40b4-8117-4b87f51607cb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1516 microversion: 2.1 time: 0.273228 May 27 03:37:12.727026 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 98/174] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:12 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:12.747838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:12.749133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:12.764460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:12.768022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:12.774764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:12.776308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:12.779712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.780165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.781139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.781424 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.785811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d28f6356-b622-471d-9e34-4988dc443fef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.300740 May 27 03:37:12.791593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 77/175] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:12 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:37:12.804579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:12.807373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:12.823011 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.824150 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.825835 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:12.826802 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:12.829259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lazy-loading 'flavor' on Instance uuid 94909255-c0eb-42c8-86f4-d3622d539f0c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:37:13.059723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:13.062220 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=8 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:13.067964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e06abe59-13ed-426c-b080-efa105666e30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.271641 May 27 03:37:13.068647 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 78/176] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:12 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:13.207506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e8e6356a-9a80-4ee0-8ada-d3501edb2727 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c/action" status: 200 len: 32 microversion: 2.1 time: 0.466480 May 27 03:37:13.218220 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 99/177] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:37:12 2022] POST /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:37:13.218373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:13.218574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:13.220713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:13.227132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:13.227928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:13.228706 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:13.229207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:13.365607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:13.373053 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f4935a0f-864d-4873-9a03-1a7962f41d4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.159201 May 27 03:37:13.373635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 79/178] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:13 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:13.810778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:13.814378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:13.829000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:13.829458 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:13.830495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:13.831087 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:14.046972 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:14.058248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:14.062637 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:14.064281 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-422f6752-081a-4145-9d6c-a211e1f16a2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.260766 May 27 03:37:14.065034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 100/179] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:13 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:14.103914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:14.105019 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:14.113517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:14.114373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:14.115887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:14.116619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:14.284131 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:14.292491 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-28e0f0c4-3d82-4ccc-aae6-802719c436c3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.195910 May 27 03:37:14.293168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 80/180] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:14 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:14.392245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:14.393063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:14.399984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:14.400432 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:14.401202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:14.401644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:14.603707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:14.612661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4da7603f-4bce-411c-9473-e93b2b63ee61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.225255 May 27 03:37:14.614097 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 101/181] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:14 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:15.094372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:15.095019 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:15.103991 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:15.105355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:15.106413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:15.107205 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:15.301623 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:15.309755 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:15.310403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:15.310645 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:15.311942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:15.313926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6211873d-a85f-4d19-9e05-ba09875c3ab7 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.226520 May 27 03:37:15.314885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 81/182] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:15 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:15.319157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:15.321993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:15.321993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:15.321993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:15.491878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:15.504034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9926d913-8a39-440d-82c3-35dc644a2325 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.198112 May 27 03:37:15.504634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 102/183] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:15 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:15.629458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:15.630069 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:15.632460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=18 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:15.637326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:15.637780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:15.638540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:15.639001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:15.785514 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:15.793132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ae8d36e1-c872-4bc1-967d-d16898dafa0a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.166993 May 27 03:37:15.793787 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 82/184] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:15 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:16.333388 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:16.335191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:16.347641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:16.347641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:16.347641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:16.347641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:16.443886 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1261213262", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "networks": [{"uuid": "fc7d4913-1a98-471a-8f02-141f8db23d39"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:16.543661 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] validate_networks() for [('fc7d4913-1a98-471a-8f02-141f8db23d39', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:37:16.565583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:16.575629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:16.579078 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:16.582485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6aae3b5c-f347-407d-a74a-ee8accaef754 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.252815 May 27 03:37:16.584059 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 103/185] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:16 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:16.592011 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:16.593363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:16.604300 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:16.604898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:16.605767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:16.606416 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:16.901318 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:16.909283 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8f583c88-70f2-493b-a430-29475b963068 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.322995 May 27 03:37:16.915696 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 104/186] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:16 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:16.928540 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:16.931709 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:16.933762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:16.950076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:16.950559 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:16.951412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:16.951827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.153073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:37:17.153698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:37:17.159031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:37:17.159031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:37:17.159031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:37:17.172691 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:17.173157 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.173976 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:17.176509 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.197103 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:17.204483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Getting quotas for project 09b89ed90acc4dd2aa3bca17bb1a1fe9. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:37:17.205193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-39c03106-0a25-474f-8ea2-0b62a684a638 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.288462 May 27 03:37:17.206067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 105/187] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:16 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:17.210798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Getting quotas for user 1d76f23d7b614fac857a9aefd2d345b6 and project 09b89ed90acc4dd2aa3bca17bb1a1fe9. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:37:17.224072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:37:17.227276 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:37:17.395987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6b8ee3cd-0868-48bc-88a4-abba0d769e8e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957331 May 27 03:37:17.397424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 83/188] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:37:17.407351 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7ee9fd0e-2e91-4081-8fbd-7624605dddc6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:17.407993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7ee9fd0e-2e91-4081-8fbd-7624605dddc6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:17.482590 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ee9fd0e-2e91-4081-8fbd-7624605dddc6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:17.489357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7ee9fd0e-2e91-4081-8fbd-7624605dddc6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1214 microversion: 2.1 time: 0.086205 May 27 03:37:17.499345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 106/189] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:17 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:17.603181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:17.603956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:17.611057 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:17.611501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.612967 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:17.613453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.770229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:17.780597 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:17.782105 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:17.783317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-de95b42f-23c3-44e4-b92f-474814190a2d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.186386 May 27 03:37:17.783876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 84/190] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:17 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:17.932518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:17.933122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:17.939170 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:17.939611 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.940399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:17.940827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:17.959288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:18.076285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:18.087245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d3d5144b-5272-4462-9bd9-9f5dbc1b7df2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.158361 May 27 03:37:18.087788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 107/191] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:17 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:18.222395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:18.223051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:18.229833 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:18.230286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:18.231208 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:18.231641 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:18.364450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:18.372132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d61a29b3-eb3e-4e93-9453-d7dd8707d872 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.153690 May 27 03:37:18.372705 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 85/192] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:18 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:18.494953 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-ce340e44-c235-454f-a08d-f9cb1bed928b req-c86ac011-55b8-4a69-a4bf-41c715441fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1", "name": "network-vif-plugged", "status": "completed", "tag": "56827ab0-a142-44a1-9dc8-40a1076ef828"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:18.508183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cf7aa7ed-5c40-454c-b6ed-e30454fa5d2c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:18.508861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cf7aa7ed-5c40-454c-b6ed-e30454fa5d2c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:18.530989 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ce340e44-c235-454f-a08d-f9cb1bed928b req-c86ac011-55b8-4a69-a4bf-41c715441fa0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:18.531634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ce340e44-c235-454f-a08d-f9cb1bed928b req-c86ac011-55b8-4a69-a4bf-41c715441fa0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:18.553024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-ce340e44-c235-454f-a08d-f9cb1bed928b req-c86ac011-55b8-4a69-a4bf-41c715441fa0 service nova] Creating event network-vif-plugged:56827ab0-a142-44a1-9dc8-40a1076ef828 for instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 on hv-cinder-82880 May 27 03:37:18.558820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-ce340e44-c235-454f-a08d-f9cb1bed928b req-c86ac011-55b8-4a69-a4bf-41c715441fa0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067507 May 27 03:37:18.559766 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 108/193] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:18.570862 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cf7aa7ed-5c40-454c-b6ed-e30454fa5d2c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:18.578781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cf7aa7ed-5c40-454c-b6ed-e30454fa5d2c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1214 microversion: 2.1 time: 0.075280 May 27 03:37:18.579393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 86/194] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:18 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:18.805358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:18.806055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:18.812215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:18.812665 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:18.813421 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:18.813895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:18.963615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:18.976771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:18.978554 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:18.982229 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d781c582-7399-4ffc-ba58-dc95b583fa6d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.179434 May 27 03:37:18.982229 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 109/195] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:18 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:19.105154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:19.105763 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:19.114252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:19.114701 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:19.115530 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:19.116129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:19.260616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:19.272899 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-de3d3e73-613e-48a5-9824-96624c6cc79a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.171494 May 27 03:37:19.273495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 87/196] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:19 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:19.389923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:19.390563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:19.399016 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:19.399481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:19.400269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:19.400713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:19.555585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:19.563827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e0e8236b-0f64-4332-81c0-85c47e3be7e8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.178060 May 27 03:37:19.564560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 110/197] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:19 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:19.596531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:19.601558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:19.605052 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:19.605527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:19.606300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:19.606767 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:19.672541 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:19.679914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d17ce303-7d79-4194-9aa0-6730032e52d4 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1210 microversion: 2.1 time: 0.087912 May 27 03:37:19.680487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 88/198] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:19 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:19.998060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:19.998656 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:20.005170 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.005652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.006450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.006940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.145613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:20.155149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:20.156822 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:20.158002 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-43b3795f-9982-4758-8d0a-9db67c021e4a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.163937 May 27 03:37:20.158565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 111/199] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:19 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:20.290058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:20.290703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:20.313651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.313651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.313651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.313651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.583754 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:20.585267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:20.592367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.592913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.593789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.594441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.795665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:20.804598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e45380c6-edda-4412-9450-6e044797e183 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1366 microversion: 2.1 time: 0.518950 May 27 03:37:20.806678 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 89/200] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:20 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:20.810452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:20.811268 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:20.818344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.818791 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.819590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:20.820026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:20.826546 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:20.834790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-21de26f0-a841-4a68-9c9a-d8127dc43788 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.257546 May 27 03:37:20.835499 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 112/201] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:20 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:20.891218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:20.898824 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-06c15d18-d606-42af-88ac-88d0a2f368eb tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1266 microversion: 2.1 time: 0.092606 May 27 03:37:20.899549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 90/202] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:20 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:21.177408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:21.178017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:21.184070 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:21.184525 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:21.185353 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:21.185802 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:21.331901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:21.340803 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:21.342612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:21.345577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-82531d6f-2024-4567-b925-cbb9a1be532b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1745 microversion: 2.20 time: 0.172021 May 27 03:37:21.346165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 113/203] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:21 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:21.821865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:21.822619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:21.829737 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:21.830219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:21.831022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:21.831561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:21.853361 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:21.853882 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:21.860616 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:21.861065 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:21.861974 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:21.862425 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.097383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:22.106331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7ad9fe0e-6819-4cb4-9469-a045b34e2910 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.258225 May 27 03:37:22.120679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:22.133369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eb2e174b-6907-4eca-bed7-d2c939b10567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1557 microversion: 2.1 time: 0.315640 May 27 03:37:22.134005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 114/204] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:21 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:22.135388 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 91/205] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:21 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1557 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:22.139294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:22.139902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:22.152823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:22.153367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:22.159692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:22.160165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.160951 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:22.161392 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.162583 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:22.163369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.165236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:22.165833 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.287871 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:22.297692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6fbdc7c2-5618-4f1a-9380-a4b9858d5f11 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149522 May 27 03:37:22.299098 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 92/206] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:37:22 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:22.300213 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-17b0ed86-4b14-4225-bcfc-6be08db55055 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1284 microversion: 2.1 time: 0.163917 May 27 03:37:22.301032 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 115/207] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:22 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:22.367616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:22.368673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:22.382542 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:22.383284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.384347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:22.384931 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:22.709653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:22.724727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:22.726246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:22.732039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5bc67215-275d-4556-b4af-a9dfd39e2132 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1745 microversion: 2.20 time: 0.370481 May 27 03:37:22.745008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 93/208] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:22 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1745 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:23.126094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:23.129418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:23.134368 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.134829 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.135667 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.136130 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.325627 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:23.328945 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:23.336999 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.337550 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.338393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.338950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.388433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:23.396235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7274209e-4e7c-4f3b-84a5-80687afd210f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.275017 May 27 03:37:23.396908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 116/209] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:23 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:23.451029 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:23.462525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cce2de81-06c6-42de-8b7c-95870a406b42 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1272 microversion: 2.1 time: 0.140837 May 27 03:37:23.463346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 94/210] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:23 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:23.759415 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:23.760151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:23.777295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.777950 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.778759 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.781489 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.804567 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-150da6dc-775a-4a2e-864b-dbe11eecd328 req-6a2f7d5c-e575-4229-9da1-8372abd5800e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1", "tag": "56827ab0-a142-44a1-9dc8-40a1076ef828"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:23.819663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-150da6dc-775a-4a2e-864b-dbe11eecd328 req-6a2f7d5c-e575-4229-9da1-8372abd5800e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:23.820116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-150da6dc-775a-4a2e-864b-dbe11eecd328 req-6a2f7d5c-e575-4229-9da1-8372abd5800e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:23.885648 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-150da6dc-775a-4a2e-864b-dbe11eecd328 req-6a2f7d5c-e575-4229-9da1-8372abd5800e service nova] Creating event network-changed:56827ab0-a142-44a1-9dc8-40a1076ef828 for instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 on hv-cinder-82880 May 27 03:37:23.894703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-150da6dc-775a-4a2e-864b-dbe11eecd328 req-6a2f7d5c-e575-4229-9da1-8372abd5800e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093797 May 27 03:37:23.895714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 95/211] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:24.207453 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:24.255302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:24.259104 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:24.262517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a1aedaba-825b-4484-ac56-3ef0a4d13834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1745 microversion: 2.20 time: 0.515096 May 27 03:37:24.263396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 117/212] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:23 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1745 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:24.414943 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:24.418813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:24.433144 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:24.433846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:24.436134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:24.438355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:24.487299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:24.487299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:24.501577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:24.502077 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:24.503945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:24.505183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:24.786686 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:24.798199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0ed5bd5e-24f3-4b8e-93e3-dd9e5d0f1c1b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.388224 May 27 03:37:24.799129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 96/213] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:24 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:24.805525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6c17b9bb-6479-43e0-ab49-6788ecc5e8d4 req-ed1fb778-71c2-4518-a5cd-4dcd7cb47cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "name": "network-vif-plugged", "status": "completed", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:24.815344 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:24.825178 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ee2d416c-35b9-40d7-bd73-d80f8e35a9e6 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.348873 May 27 03:37:24.825658 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 118/214] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:24 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:24.825768 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6c17b9bb-6479-43e0-ab49-6788ecc5e8d4 req-ed1fb778-71c2-4518-a5cd-4dcd7cb47cb2 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:24.826179 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6c17b9bb-6479-43e0-ab49-6788ecc5e8d4 req-ed1fb778-71c2-4518-a5cd-4dcd7cb47cb2 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:24.840593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:24.843666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6c17b9bb-6479-43e0-ab49-6788ecc5e8d4 req-ed1fb778-71c2-4518-a5cd-4dcd7cb47cb2 service nova] Creating event network-vif-plugged:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:37:24.849548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6c17b9bb-6479-43e0-ab49-6788ecc5e8d4 req-ed1fb778-71c2-4518-a5cd-4dcd7cb47cb2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049242 May 27 03:37:24.851175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 97/215] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:25.284376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:25.285009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:25.298574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.315519 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:25.320614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.320614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:25.557427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:25.591924 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:25.593796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:25.595285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6327c8c4-f9dd-4e64-a53c-45a2495f2dae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.317598 May 27 03:37:25.609990 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 119/216] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:25 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:25.658486 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-5b57453b-709d-4185-a7e5-8a2171ec33eb req-52253d18-6756-4013-945b-f1ae7e2070fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d00e63-2d11-40e0-ad26-8f983eb27f59", "tag": "1e8c1f2e-b130-47fa-a1b3-a3f961aa93ff"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:25.675593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-5b57453b-709d-4185-a7e5-8a2171ec33eb req-52253d18-6756-4013-945b-f1ae7e2070fd service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.677851 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-5b57453b-709d-4185-a7e5-8a2171ec33eb req-52253d18-6756-4013-945b-f1ae7e2070fd service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:25.706027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-5b57453b-709d-4185-a7e5-8a2171ec33eb req-52253d18-6756-4013-945b-f1ae7e2070fd service nova] Creating event network-changed:1e8c1f2e-b130-47fa-a1b3-a3f961aa93ff for instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 on hv-cinder-82880 May 27 03:37:25.717754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-5b57453b-709d-4185-a7e5-8a2171ec33eb req-52253d18-6756-4013-945b-f1ae7e2070fd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065130 May 27 03:37:25.718805 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 98/217] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:25.816436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:25.817096 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:25.827064 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.828212 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:25.829557 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.831663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:25.844440 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:25.845584 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:25.865240 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.869635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:25.869635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:25.869635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:26.162596 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:26.171668 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bb88b6af-f255-4c68-aefc-1a1ed499acde tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.359247 May 27 03:37:26.175435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 120/218] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:25 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:26.210673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:26.219146 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e5f51918-cd6e-431f-ba24-a599e6170cd7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.380312 May 27 03:37:26.220390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 99/219] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:25 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:26.617161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:26.619265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:26.641149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:26.642436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:26.644058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:26.644845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:26.881284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:26.903470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:26.908302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:26.912654 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-879ec604-2110-4e8a-a236-f6fb9253db81 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.299967 May 27 03:37:26.928348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 121/220] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:26 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:27.194618 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:27.195471 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:27.201120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:27.210213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:27.211409 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:27.212399 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:27.213044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:27.241154 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:27.247782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:27.262561 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:27.265724 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:27.270618 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:27.270618 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:27.487398 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:27.511860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:27.520763 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3d13535c-fc44-4928-9e33-c7ac6f5805c2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.331008 May 27 03:37:27.521384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 100/221] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:27 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:27.526346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:27.537936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-faf2dd8c-5f32-4c9b-8be2-bc1e5a7c7539 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.302834 May 27 03:37:27.537936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 122/222] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:27 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:27.944433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:27.945037 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:27.951144 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:27.951590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:27.952341 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:27.953039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:28.087161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:28.095116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:28.096649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:28.097806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c0dc979b-3743-4386-aa81-1bfc7ee145c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.157278 May 27 03:37:28.098376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 101/223] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:27 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:28.538054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:28.538726 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:28.545888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:28.546339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:28.547172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:28.547607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:28.566429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:28.567875 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:28.576468 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:28.576903 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:28.578562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:28.579027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:28.579544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=8 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:28.754986 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:28.761801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:28.763677 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6078f2d2-20fe-4c60-a5e0-09d631552aa9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.229407 May 27 03:37:28.769857 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-36247f07-d721-43b1-aa36-316e04949407 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.207626 May 27 03:37:28.777012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 102/224] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:28 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:28.777127 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 123/225] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:28 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:29.121609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:29.122477 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:29.129367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:29.129814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:29.131159 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:29.131786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:29.333302 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:29.342863 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:29.344727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:29.346075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-43c79f88-1cf7-401c-bdf7-13db74ea8603 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.228812 May 27 03:37:29.346877 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 103/226] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:29 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:37:29.784637 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:29.793316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:29.794631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:29.798047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:29.808620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:29.812876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:29.833531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:29.833531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:29.834005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:29.834005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:29.834005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:29.834005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:30.038404 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:30.041099 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:30.044998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:30.048675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5a49e8d7-e857-4f4b-8e2d-16df129b286e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.259388 May 27 03:37:30.050133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-44e3baba-0cb3-412b-ae9d-6fd6ae5b6903 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.272487 May 27 03:37:30.058227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 104/227] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:29 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:30.062219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 124/228] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:29 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:30.365234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:30.366245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:30.382450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:30.382450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:30.382450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:30.382450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:30.435644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-847908355", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2016079672", "security_groups": [{"name": "tempest-secgroup-smoke-773143031"}], "networks": [{"uuid": "430833dd-8c2a-4184-8f60-2460eb1e769c"}], "block_device_mapping_v2": [{"uuid": "b30a41bf-c3c4-43c0-91c1-7b033a5cfb77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:30.619396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:30.632137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:30.634050 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:30.636418 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a820023d-7412-48d7-97c8-1be076a3f9c5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.276603 May 27 03:37:30.636568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] validate_networks() for [('430833dd-8c2a-4184-8f60-2460eb1e769c', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:37:30.639190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 105/229] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:30 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:30.667869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6c32eade-dfdc-4189-951a-ae5eebb8ed8b req-5c725b65-b7f2-481d-a95d-dda64424f8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d00e63-2d11-40e0-ad26-8f983eb27f59", "name": "network-vif-plugged", "status": "completed", "tag": "1e8c1f2e-b130-47fa-a1b3-a3f961aa93ff"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:30.676785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6c32eade-dfdc-4189-951a-ae5eebb8ed8b req-5c725b65-b7f2-481d-a95d-dda64424f8fb service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:30.677375 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6c32eade-dfdc-4189-951a-ae5eebb8ed8b req-5c725b65-b7f2-481d-a95d-dda64424f8fb service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:30.689554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6c32eade-dfdc-4189-951a-ae5eebb8ed8b req-5c725b65-b7f2-481d-a95d-dda64424f8fb service nova] Creating event network-vif-plugged:1e8c1f2e-b130-47fa-a1b3-a3f961aa93ff for instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 on hv-cinder-82880 May 27 03:37:30.695278 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6c32eade-dfdc-4189-951a-ae5eebb8ed8b req-5c725b65-b7f2-481d-a95d-dda64424f8fb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031292 May 27 03:37:30.696082 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 106/230] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:37:31.073553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:31.074929 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:31.093577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.096419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.097823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.098871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.127573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:37:31.127573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:37:31.127573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:37:31.127573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:37:31.127573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:37:31.161357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.162948 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.163941 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.165552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.203700 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Getting quotas for project 19592ab2e5e04d7c952aebf73f4fca6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:37:31.210957 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Getting quotas for user 9001a4b10d544226b3b1453b06883db4 and project 19592ab2e5e04d7c952aebf73f4fca6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:37:31.304594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:31.306728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:37:31.309445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b30a41bf-c3c4-43c0-91c1-7b033a5cfb77',volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:37:31.312675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ee090c91-f59f-425a-b552-9a4e77cae010 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.246365 May 27 03:37:31.323760 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 107/231] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:31 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:31.324817 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:31.325447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:31.334012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.334461 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.335257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.335691 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.530083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:31.539195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c44d63e8-8490-4dac-926b-8a20b0a054a7 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.221238 May 27 03:37:31.540205 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 108/232] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:31 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:31.669828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:31.671643 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:31.686008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.686642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.687581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:31.688021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:31.884966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:31.894572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:31.900289 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:31.902676 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-093cd8ed-fd95-415b-b653-129850d5d7f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.244859 May 27 03:37:31.903916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 109/233] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:31 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:31.924824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b66989e6-769d-4f46-a73b-d5eda86cc7b5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.493989 May 27 03:37:31.929658 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 125/234] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:37:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:37:31.936146 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fdeee0ab-3771-4305-9dfb-c28007ed3f0d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:31.936910 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fdeee0ab-3771-4305-9dfb-c28007ed3f0d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:31.998209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fdeee0ab-3771-4305-9dfb-c28007ed3f0d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:32.007146 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fdeee0ab-3771-4305-9dfb-c28007ed3f0d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1088 microversion: 2.1 time: 0.075115 May 27 03:37:32.019394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 110/235] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:31 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:32.331806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:32.332615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:32.340299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:32.345568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:32.345568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:32.345568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:32.538239 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:32.547572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4a636304-5f66-46aa-9dc5-65cbea2f4e1d tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.220080 May 27 03:37:32.549477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 126/236] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:32 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:32.563532 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:32.564148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:32.575509 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:32.575960 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:32.576904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:32.577507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:32.793677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:32.802828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fb07e9d1-937b-4df4-9de0-a5e715c5c675 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1314 microversion: 2.1 time: 0.243000 May 27 03:37:32.805000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 111/237] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:32 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:32.924777 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:32.925733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:32.938374 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:32.938813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:32.941089 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:32.941543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:33.024528 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f92970d-d308-45c3-b2c8-d8117e2e6c0a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:33.025305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f92970d-d308-45c3-b2c8-d8117e2e6c0a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:33.112121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f92970d-d308-45c3-b2c8-d8117e2e6c0a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:33.124390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f92970d-d308-45c3-b2c8-d8117e2e6c0a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1088 microversion: 2.1 time: 0.104410 May 27 03:37:33.134528 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 112/238] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:33 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1088 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:33.178493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:33.190147 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:33.193879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:33.195437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dd7157b0-8648-46d1-b8d9-4b53fd75b062 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.277547 May 27 03:37:33.197628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 127/239] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:32 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:33.568407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:33.569544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:33.585043 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:33.585961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:33.586942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:33.587595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:33.823680 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:33.825298 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:33.832866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:33.834210 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:33.848516 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:33.851479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:34.187261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:34.195843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0a94dfea-2fd8-4d5c-a82f-efb45406a972 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.633770 May 27 03:37:34.205731 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 113/240] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:33 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:34.211534 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:34.212489 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:34.219128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:34.223823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:34.223823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:34.223823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:34.246728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:34.255664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0798a48f-194a-4ccf-bdae-7383ed5a0416 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1498 microversion: 2.1 time: 0.437589 May 27 03:37:34.256868 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 128/241] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:33 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1498 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:34.262435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:34.263387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:34.272535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:34.276075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:34.276075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:34.276075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:34.323436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:34.346804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7712e134-a0cc-43d4-bcb3-11180bf2298c tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1186 microversion: 2.1 time: 0.129024 May 27 03:37:34.347742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 114/242] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:34 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1186 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:34.466793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:34.476028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:34.477836 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:34.478708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ac9b2a9e-e88e-45db-91dc-dd58e5b0154a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.220737 May 27 03:37:34.479676 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 129/243] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:34 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:35.213644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:35.214288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:35.220936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.221381 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.222216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.222650 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.355054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:35.355734 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:35.372823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.373297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.378438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.383129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.478132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:35.486188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f59ece75-545f-449a-a514-d91ea52b022c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.276366 May 27 03:37:35.502850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 115/244] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:35 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:35.510757 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:35.515612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:35.531149 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.531867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.532738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.535332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.564766 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:35.572300 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-07d44a96-c19c-4402-8ba2-2249a968038a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1194 microversion: 2.1 time: 0.222415 May 27 03:37:35.584246 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 130/245] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:35 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1194 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:35.763791 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:35.782427 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:35.786161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:35.795021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5d1f9e86-bbe4-4808-b22b-80a73c4eb66e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.284983 May 27 03:37:35.795021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 116/246] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:35 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:35.935773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:35.936781 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:35.949765 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.950297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:35.951228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:35.951739 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.012388 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:37:36.405328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0ae62c22-9648-4467-a03b-0ab803a7a139 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 204 len: 0 microversion: 2.1 time: 0.473115 May 27 03:37:36.407106 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 131/247] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:37:35 2022] DELETE /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:37:36.416343 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:36.417050 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:36.425013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.425692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.426738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.427405 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.511132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:36.512409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:36.543005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.544732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.544732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.546606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.676104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:36.683233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:36.687074 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9069eeee-e039-4852-8848-5a15ead5513c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1504 microversion: 2.1 time: 0.275533 May 27 03:37:36.703734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 117/248] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:36 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:36.723347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:36.724014 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:36.752249 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.752707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.761741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.762227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.931215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:36.941735 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-819d7a11-7640-4bdd-ab2e-fd81334b27eb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.435926 May 27 03:37:36.947792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 132/249] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:36 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:36.962212 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:36.965543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:36.982800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.986828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:36.987975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:36.990197 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:37.201792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:37.217993 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6b193ed3-8e40-4a29-83b7-b22c74203ddc tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1271 microversion: 2.1 time: 0.511498 May 27 03:37:37.218861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 118/250] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:36 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:37.244788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:37.254528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:37.256987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:37.258956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fbee115e-3d64-4533-91b4-940b5f177289 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.307053 May 27 03:37:37.260092 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 133/251] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:36 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:37.705784 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:37.706326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:37.713907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:37.715680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:37.716387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:37.717160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:37.717603 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:37.965095 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:37.967020 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:37.968001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:37.975914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2ecd58d9-1c65-4721-9505-fe014f1eb9af tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1504 microversion: 2.1 time: 0.274266 May 27 03:37:37.987316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 119/252] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:37 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:37.987787 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:37.990424 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:37.993786 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:37.993786 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:38.203242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:38.213235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1eb3ff72-6a83-40f6-b181-408036363a8b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.252529 May 27 03:37:38.214381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 134/253] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:37 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:38.241859 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:38.241859 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:38.256312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:38.257235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:38.266321 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:38.267003 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:38.279258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:38.280696 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:38.290154 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:38.291031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:38.292149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:38.292857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:38.747880 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:38.761027 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:38.765688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:38.767037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-85f9c803-3933-4d1e-9f92-66267b363119 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.492893 May 27 03:37:38.782448 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 135/254] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:38 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:38.836247 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:38.845573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a3d0285e-0200-48bd-9c55-b9fb3406c16a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1271 microversion: 2.1 time: 0.613703 May 27 03:37:38.861924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 120/255] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:38 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1271 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:38.994195 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:38.995477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:39.008153 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.010772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.013304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.013910 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.235297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:39.240248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:39.252182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.253031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.254972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.255457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.390482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:39.405073 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5254bf69-039d-495f-a600-6504e4767647 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1504 microversion: 2.1 time: 0.415421 May 27 03:37:39.405667 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 136/256] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:38 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:39.477758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:39.511347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-164f3168-1195-41fb-8b6c-cf3548fc8497 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.280864 May 27 03:37:39.515136 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 121/257] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:39 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:39.796655 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:39.799257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:39.839294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.839941 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.842575 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.843251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.864727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:39.869009 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:39.892775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.893412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:39.901529 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:39.907285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:40.272543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:40.281863 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:40.283978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:40.286277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f5a4f55a-92fc-4826-a604-793b7bb869d1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.503224 May 27 03:37:40.288622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 137/258] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:39 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:37:40.311444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:40.319922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-972cf631-0680-4c42-b924-f6a0392beb17 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.460242 May 27 03:37:40.330438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 122/259] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:39 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:40.429258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:40.429966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:40.436593 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:40.437294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:40.438129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:40.440151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:40.529344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:40.529960 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:40.538091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:40.538668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:40.539579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:40.540116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:40.598935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:40.607050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-06f81245-1a20-4719-b010-86485fb232f0 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1504 microversion: 2.1 time: 0.184119 May 27 03:37:40.617301 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 138/260] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:40 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:40.714601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:40.730248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-89f22107-0a5d-4e76-b49d-1e48d6326ad0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.204710 May 27 03:37:40.732818 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 123/261] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:40 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:40.841853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-a844673d-555a-435a-b72c-6d8ad863a7e0 req-f4a6ac3d-127a-476f-9e73-98a970a884e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d00e63-2d11-40e0-ad26-8f983eb27f59", "name": "network-vif-deleted", "tag": "1e8c1f2e-b130-47fa-a1b3-a3f961aa93ff"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:40.879619 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a844673d-555a-435a-b72c-6d8ad863a7e0 req-f4a6ac3d-127a-476f-9e73-98a970a884e0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:40.880904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a844673d-555a-435a-b72c-6d8ad863a7e0 req-f4a6ac3d-127a-476f-9e73-98a970a884e0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:40.901486 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-a844673d-555a-435a-b72c-6d8ad863a7e0 req-f4a6ac3d-127a-476f-9e73-98a970a884e0 service nova] Creating event network-vif-deleted:1e8c1f2e-b130-47fa-a1b3-a3f961aa93ff for instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 on hv-cinder-82880 May 27 03:37:40.939209 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-a844673d-555a-435a-b72c-6d8ad863a7e0 req-f4a6ac3d-127a-476f-9e73-98a970a884e0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100815 May 27 03:37:40.939591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 139/262] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:41.309488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:41.309878 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:41.323871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.324573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.325790 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.338387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:41.344392 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:41.361347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.366597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:41.373525 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:41.384430 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.385284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.389517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.390441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.729734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:41.736279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:41.738936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:41.742531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:41.744402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-88918d7b-bb6b-46cd-9874-1fa50e6c80a2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.442573 May 27 03:37:41.746892 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-10afeeae-1998-4217-be7a-3be9c15b5e19 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.412622 May 27 03:37:41.747820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 140/263] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:41 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:41.752904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:41.753756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:41.767311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 124/264] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:41 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:41.767513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.767513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.767513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.767513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.770174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:41.771066 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:41.773241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:41.779611 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.780335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.781480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.782072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.813419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:41.814328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:41.815114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lazy-loading 'fault' on Instance uuid a7d00e63-2d11-40e0-ad26-8f983eb27f59 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:37:41.909190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:41.919492 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-776b182a-0ce1-4f5b-b7ef-9fd5437a9259 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 200 len: 1304 microversion: 2.1 time: 0.170426 May 27 03:37:41.921674 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 141/265] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:41 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:41.994118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:42.002198 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ba49642e-cd4b-475b-9f50-37ee8a5a0adc tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.241642 May 27 03:37:42.006043 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 125/266] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:41 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:42.777132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:42.778459 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:42.779221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:42.780922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:42.786627 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:42.788567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:42.789243 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:42.789451 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:42.789734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:42.790608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:42.791377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:42.792074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:42.792743 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.008457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:43.017611 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:43.019718 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:43.021553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-042babcd-c00c-41ed-81d8-9cc2f711ff42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1740 microversion: 2.20 time: 0.246606 May 27 03:37:43.033165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 126/267] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:42 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:43.039261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:43.039884 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: a7d00e63-2d11-40e0-ad26-8f983eb27f59] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:43.041879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:43.046460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.047180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.048109 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.048712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.050204 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8ebb6951-e2c0-453f-ac6e-e94e1ed4f074 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.278405 May 27 03:37:43.051015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 142/268] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:42 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:43.056889 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-a93a1cb9-92ee-44f0-b41e-a2a7b9267a78 req-5681f4d9-2aa3-4c1d-95ba-040ad7aeffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:43.067925 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a93a1cb9-92ee-44f0-b41e-a2a7b9267a78 req-5681f4d9-2aa3-4c1d-95ba-040ad7aeffb7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.069398 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-a93a1cb9-92ee-44f0-b41e-a2a7b9267a78 req-5681f4d9-2aa3-4c1d-95ba-040ad7aeffb7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.073922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] HTTP exception thrown: Instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 could not be found. May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Request method failure captured: May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 HTTP/1.1 May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEdq0FfF82MkVkh0T8pfFXayxelx7oIqrnHqt0q4I5AZE6qrYS_KtpYwFf0Gm3me-IKnZPdlTJLXmgVqekALC5BPYSfUED-bOAjiTA2OMHKNoqQxeJz8KI9-y2gUTTQdFWm4WFL6d7CDl855WqwBlbtaz5_2P4RTWIsVehcL0ZoIGjw May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 09b89ed90acc4dd2aa3bca17bb1a1fe9 May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesActionsTest-1217221362 May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:37:43.075996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_09b89ed90acc4dd2aa3bca17bb1a1fe9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/09b89ed90acc4dd2aa3bca17bb1a1fe9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/09b89ed90acc4dd2aa3bca17bb1a1fe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/09b89ed90acc4dd2aa3bca17bb1a1fe9"}]}] May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesActionsTest-1217221362 May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 09b89ed90acc4dd2aa3bca17bb1a1fe9 May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesActionsTest-1217221362 May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesActionsTest-1217221362-project May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 1d76f23d7b614fac857a9aefd2d345b6 May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesActionsTest-1217221362-project May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 could not be found. May 27 03:37:43.077348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': 'a7d00e63-2d11-40e0-ad26-8f983eb27f59'} May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 could not be found. May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:37:43.078420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 could not be found. May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 could not be found. May 27 03:37:43.079973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:37:43.082252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Returning 404 to user: Instance a7d00e63-2d11-40e0-ad26-8f983eb27f59 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:37:43.082704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fc56f037-1271-4ec0-8129-f817c336051a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59" status: 404 len: 111 microversion: 2.1 time: 0.048262 May 27 03:37:43.085383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 127/269] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:43 2022] GET /compute/v2.1/servers/a7d00e63-2d11-40e0-ad26-8f983eb27f59 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:37:43.091252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:43.092108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:43.099853 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.100311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.104297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.104297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.104533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-a93a1cb9-92ee-44f0-b41e-a2a7b9267a78 req-5681f4d9-2aa3-4c1d-95ba-040ad7aeffb7 service nova] Creating event network-changed:0aa36f0b-ffa2-488e-b031-21fe9c191622 for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 on hv-cinder-82880 May 27 03:37:43.108918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-a93a1cb9-92ee-44f0-b41e-a2a7b9267a78 req-5681f4d9-2aa3-4c1d-95ba-040ad7aeffb7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055659 May 27 03:37:43.109635 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 143/270] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:43.127589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:43.215964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1442377951", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "networks": [{"uuid": "fc7d4913-1a98-471a-8f02-141f8db23d39"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:43.286060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] validate_networks() for [('fc7d4913-1a98-471a-8f02-141f8db23d39', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:37:43.324716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:43.335442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fd95f08f-96e2-4c38-8025-32652a06bfb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.247897 May 27 03:37:43.337429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 128/271] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:43 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:43.714877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:37:43.715305 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:37:43.715780 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:37:43.716188 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:37:43.716598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:37:43.732725 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.733176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.733975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:43.734491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:43.754397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Getting quotas for project 09b89ed90acc4dd2aa3bca17bb1a1fe9. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:37:43.760705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Getting quotas for user 1d76f23d7b614fac857a9aefd2d345b6 and project 09b89ed90acc4dd2aa3bca17bb1a1fe9. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:37:43.772903 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:37:43.775412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:37:43.906245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-77c4a55b-f698-4e0b-8993-548e85470455 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695910 May 27 03:37:43.907750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 144/272] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:37:43.918377 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-01791de3-80ac-49b6-a532-c5e643e6ee0a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:43.919596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-01791de3-80ac-49b6-a532-c5e643e6ee0a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:43.990518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-01791de3-80ac-49b6-a532-c5e643e6ee0a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:43.999200 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-01791de3-80ac-49b6-a532-c5e643e6ee0a tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1214 microversion: 2.1 time: 0.084771 May 27 03:37:43.999785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 129/273] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:43 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:44.040738 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:44.041356 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:44.048540 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:44.049009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:44.053149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:44.053149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:44.075028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:44.075673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:44.095052 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:44.095332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:44.107627 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:44.108087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:44.287154 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:44.299129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:44.303700 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:44.305117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6fd13940-dde2-42a4-bd1c-9306a5cb4338 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1722 microversion: 2.20 time: 0.268937 May 27 03:37:44.308048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 145/274] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:44 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:37:44.339888 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:44.348357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dc03e4b8-6a9b-4d4e-acaa-7b24d31384ba tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.280849 May 27 03:37:44.353975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:44.355395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:44.366517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 130/275] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:44 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:44.374197 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:44.374655 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:44.378371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:44.378822 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:44.612136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:44.626231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-15691a31-bc96-4932-afae-87263576bd3f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.276433 May 27 03:37:44.627262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 146/276] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:44 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:45.017093 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b826bd31-1f15-4fcc-9503-12e09dac9324 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:45.019272 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b826bd31-1f15-4fcc-9503-12e09dac9324 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:45.084921 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b826bd31-1f15-4fcc-9503-12e09dac9324 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:45.093076 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b826bd31-1f15-4fcc-9503-12e09dac9324 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1214 microversion: 2.1 time: 0.080092 May 27 03:37:45.094088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 131/277] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:45 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:45.340481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:45.340481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:45.350519 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:45.351402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:45.352431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:45.353090 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:45.369542 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:45.370403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:45.384501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:45.384946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:45.385718 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:45.386150 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:45.592021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:45.602367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:45.613542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:45.613542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ac50d265-9c3b-4558-a561-402a3570786a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1722 microversion: 2.20 time: 0.273731 May 27 03:37:45.613542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 147/278] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:45 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:45.613754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:45.616570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3260d279-f475-451e-96c5-4992ceee0c70 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.253999 May 27 03:37:45.617265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 132/279] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:45 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:45.645609 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:45.646228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:45.652719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:45.653015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:45.653776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:45.654206 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:45.802982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:45.813232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52f313af-f7ee-4132-a686-3a3ad95fbf53 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.171389 May 27 03:37:45.814343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 148/280] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:45 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:46.109983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:46.110430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:46.117585 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.118114 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.118978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.119487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.201513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:46.211811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8ad1239d-673c-440e-a4a8-186144968513 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1210 microversion: 2.1 time: 0.105421 May 27 03:37:46.212433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 133/281] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:46 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:46.460838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1432202f-0f05-4541-aaa9-ac6cf69b46cf req-b11a083e-9483-43a4-b4b6-bfe23681902b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "name": "network-vif-unplugged", "status": "completed", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:46.472165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1432202f-0f05-4541-aaa9-ac6cf69b46cf req-b11a083e-9483-43a4-b4b6-bfe23681902b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.472795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1432202f-0f05-4541-aaa9-ac6cf69b46cf req-b11a083e-9483-43a4-b4b6-bfe23681902b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.488292 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1432202f-0f05-4541-aaa9-ac6cf69b46cf req-b11a083e-9483-43a4-b4b6-bfe23681902b service nova] Creating event network-vif-unplugged:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:37:46.497819 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1432202f-0f05-4541-aaa9-ac6cf69b46cf req-b11a083e-9483-43a4-b4b6-bfe23681902b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039978 May 27 03:37:46.498176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 149/282] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:46.624069 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:46.624687 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:46.631662 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.632117 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.632892 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.633326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.635029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:46.641147 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:46.643789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.644448 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.645389 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.646592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.899977 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:46.910501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:46.917615 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:46.919332 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:46.919973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-846cca18-9a27-4d6f-8a1e-bb2e4bfc3983 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1722 microversion: 2.20 time: 0.299137 May 27 03:37:46.922046 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 134/283] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:46 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:46.928102 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:46.928719 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:46.930524 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1bfbdb4e-17ed-4fc8-9c12-b00bd0125330 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.300397 May 27 03:37:46.939971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.939971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.939971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:46.940209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:46.941193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 150/284] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:46 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:47.121527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:47.131560 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9d8b1574-ae47-4938-92c7-7e28b8fb4dcf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.208530 May 27 03:37:47.132157 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 135/285] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:46 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:47.233835 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:47.234544 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:47.241057 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:47.241504 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:47.242333 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:47.242813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:47.309517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:47.322411 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bd8104d0-ddd7-44b1-999c-447ecb5eee01 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1210 microversion: 2.1 time: 0.092917 May 27 03:37:47.323043 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 151/286] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:47 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:47.941121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:47.941907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:47.950413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:47.950990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:47.954737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:47.954737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:47.955288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:47.955288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:47.961421 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:47.962476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:47.963516 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:47.964164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:48.256622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:48.262481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:48.268997 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:48.271911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-09d07063-e327-4901-8c98-893ba468ab53 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.323370 May 27 03:37:48.272892 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 152/287] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:47 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:48.275127 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:48.277424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6492ab64-da89-4cae-84f7-59daa6bb230f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1722 microversion: 2.20 time: 0.340208 May 27 03:37:48.278043 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:48.278692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:48.280748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 136/288] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:47 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:48.292704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:48.293366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:48.294319 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:48.294809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:48.340220 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:48.346548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:48.347292 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:48.347747 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:48.348516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:48.349590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:48.354746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:48.504637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:48.514024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7fcaf1ba-3d95-407d-a0ff-2be3c37e4d89 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1266 microversion: 2.1 time: 0.178557 May 27 03:37:48.514966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 137/289] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:48 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:48.564607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:48.573125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-632c719b-bfd6-4710-97e8-e418516190dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.298820 May 27 03:37:48.583865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 153/290] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:48 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:49.291099 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:49.305118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:49.305274 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:49.305274 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:49.309299 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.309924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.310865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.311195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.311670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.312142 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.312956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.313497 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.566413 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:49.583752 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:49.586402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:49.587670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1271abf3-0a17-4ae8-a9aa-b1a83dce6396 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1725 microversion: 2.20 time: 0.294015 May 27 03:37:49.588272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 154/291] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:49 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:37:49.595235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:49.596245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:49.605330 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:49.608243 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.608771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.609834 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.610472 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.611196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0686c6da-8296-465a-83e7-3824e5d28ed6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.325161 May 27 03:37:49.621161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 138/292] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:49 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:49.628361 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:49.630024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:49.638344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.639278 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.640547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.641305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.730334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:49.738576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52b8aabc-3756-4d67-9738-bf7b71c62e3b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1266 microversion: 2.1 time: 0.148887 May 27 03:37:49.740067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 155/293] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:49 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:49.745169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26bde7da-92cc-4087-926a-1ddbeef8ff2a"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:49.749695 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:49.771078 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.771548 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.772572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:49.773191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:49.844305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:49.853524 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e996630a-5c73-488f-a834-d55902ec70f4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.231112 May 27 03:37:49.856890 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 139/294] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:49 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:50.634049 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:50.634663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:50.642053 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:50.642734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:50.643681 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:50.646129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:50.868262 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:50.878405 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d91d239a-9908-422b-8db8-799391f5abe3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.250187 May 27 03:37:50.879031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 140/295] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:50 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:50.888703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:50.888703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:50.892714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:50.892850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:50.893582 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:50.894226 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:50.964358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:50.972593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6bb0de9f-e6d2-43ae-9d14-eb64c8bb1a18 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1272 microversion: 2.1 time: 0.092430 May 27 03:37:50.974037 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 141/296] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:50 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:50.978644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:50.979274 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:50.985607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:50.986058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:50.986825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:50.987281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.107881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:51.185161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4d4c91be-357c-44c4-8859-0f27fb43808a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.443726 May 27 03:37:51.190870 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 156/297] 10.222.0.24 () {62 vars in 1363 bytes} [Fri May 27 03:37:49 2022] POST /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 188 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:37:51.212638 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:51.223407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1646d705-ab93-467a-9186-89db70dd3a6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.248167 May 27 03:37:51.224063 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 142/298] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:50 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:51.332837 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:51.332837 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:51.338955 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.339719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.340827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.340954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.662824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1e36e605-8542-4999-a51c-97187c3f1e01 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/action" status: 202 len: 0 microversion: 2.20 time: 0.337269 May 27 03:37:51.665318 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 157/299] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 27 03:37:51 2022] POST /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:37:51.674095 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:51.675051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:51.684333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.684980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.685893 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.686332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.853071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:51.865469 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:51.867956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:51.870020 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f38d39f-6ab4-4680-9703-2a9f3c0ceeae tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1751 microversion: 2.20 time: 0.199462 May 27 03:37:51.871965 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 143/300] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:51 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:51.896984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:51.898260 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:51.909647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.910102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.911345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.919503 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:51.990138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:51.990781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:51.998479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:51.999190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:52.000710 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:52.001300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:52.142434 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:52.150610 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-88faf365-18d7-4b7a-8304-0d973403d7c4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.259234 May 27 03:37:52.184866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 158/301] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:51 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:52.242285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:52.242998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:52.250874 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:52.251687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:52.252479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:52.252919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:52.290496 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:52.300174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d43b48ad-ece5-4d91-b6d2-d584ea1bc752 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.314444 May 27 03:37:52.300913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 144/302] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:51 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:52.483000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:52.507358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-812b3783-df52-452a-8d12-7ade8977a66f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1522 microversion: 2.1 time: 0.270372 May 27 03:37:52.507947 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 159/303] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:52 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:52.889867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:52.890539 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:52.897613 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:52.899310 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:52.900443 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:52.901204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.109352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.122828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.126955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.128982 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-40ac37ee-84e5-4afc-a9b3-39e671a19f54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1751 microversion: 2.20 time: 0.243066 May 27 03:37:53.130118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 145/304] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:52 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:53.175265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:53.176757 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:53.185514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.186516 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.188623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.192047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.317667 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:53.318507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:53.330012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.330738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.334513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.335187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.455390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.467598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1bb691e6-e620-492d-875b-addebfef927a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.299597 May 27 03:37:53.502741 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 160/305] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:53 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:53.526171 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:53.527211 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:53.540371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.541554 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.544230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.545150 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.564246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.573459 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b89713ed-a152-4579-bd0e-45befe32e702 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.258982 May 27 03:37:53.585702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 146/306] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:53 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:53.716579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.725820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-02e1dc7a-e655-44c1-ad75-f3fdee433719 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1502 microversion: 2.1 time: 0.206199 May 27 03:37:53.726420 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 161/307] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:53 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:53.742183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:53.743267 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:53.750666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.751446 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.752557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:53.752989 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:53.922322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:53.931692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5c5e0d26-3150-4359-9cf6-f992c56506e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1517 microversion: 2.1 time: 0.193544 May 27 03:37:53.932590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 147/308] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:53 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:54.151981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:54.152732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:54.162470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:54.163638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:54.165409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.165968 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.166906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.167449 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.261806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-56d893f2-7a29-4f5e-96b0-03659229c7c1 req-8442ea8b-440c-4bd9-9028-a903ef301567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89", "tag": "06e71513-08ad-4d96-80b8-50c5d5424f74"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:54.280465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-56d893f2-7a29-4f5e-96b0-03659229c7c1 req-8442ea8b-440c-4bd9-9028-a903ef301567 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.281529 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-56d893f2-7a29-4f5e-96b0-03659229c7c1 req-8442ea8b-440c-4bd9-9028-a903ef301567 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.308094 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-56d893f2-7a29-4f5e-96b0-03659229c7c1 req-8442ea8b-440c-4bd9-9028-a903ef301567 service nova] Creating event network-changed:06e71513-08ad-4d96-80b8-50c5d5424f74 for instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 on hv-cinder-82880 May 27 03:37:54.316824 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-56d893f2-7a29-4f5e-96b0-03659229c7c1 req-8442ea8b-440c-4bd9-9028-a903ef301567 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058920 May 27 03:37:54.318894 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 148/309] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:37:54.486207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:54.487201 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:54.494607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.495383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.496315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.496903 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.774678 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:54.788548 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:54.790607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:54.792102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4613de6d-b814-4e3c-8115-ae32f3a19476 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1751 microversion: 2.20 time: 0.647626 May 27 03:37:54.792832 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 162/310] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:54 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1751 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:54.797588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:54.798135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:54.808881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.809611 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.810571 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.811205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:54.958147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:54.968862 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b662b93e-98a1-4cb9-ae3a-56f37fd63cfd tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.486823 May 27 03:37:54.970965 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 149/311] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:54 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:54.980957 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-2f712683-5ec9-4561-80c0-ff0f71978a51 req-aad07bee-5629-4d2e-9817-4faa47b20c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "name": "network-vif-plugged", "status": "completed", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:54.987355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-2f712683-5ec9-4561-80c0-ff0f71978a51 req-aad07bee-5629-4d2e-9817-4faa47b20c75 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:54.987884 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-2f712683-5ec9-4561-80c0-ff0f71978a51 req-aad07bee-5629-4d2e-9817-4faa47b20c75 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:55.026822 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-2f712683-5ec9-4561-80c0-ff0f71978a51 req-aad07bee-5629-4d2e-9817-4faa47b20c75 service nova] Creating event network-vif-plugged:0aa36f0b-ffa2-488e-b031-21fe9c191622 for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 on hv-cinder-82880 May 27 03:37:55.039694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-2f712683-5ec9-4561-80c0-ff0f71978a51 req-aad07bee-5629-4d2e-9817-4faa47b20c75 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066807 May 27 03:37:55.040320 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 150/312] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:37:55.104994 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:55.114065 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-701330a8-1e86-40b1-bbbc-0fcf166099fd tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.319953 May 27 03:37:55.115463 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 163/313] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:54 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:55.812204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:55.812930 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:55.814980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:55.820119 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:55.820891 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:55.821784 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:55.822434 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:55.974063 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:55.988736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:55.990047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:55.990401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:55.991369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:55.993570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8d6a0d1-48a4-4fe5-b182-6c2fa8a1231d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1753 microversion: 2.20 time: 0.184886 May 27 03:37:55.994315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 151/314] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:55 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:56.009743 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.013346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.013346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.013346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.049285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:37:56.050463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:56.059770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.060466 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.065069 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.065069 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.094234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lazy-loading 'flavor' on Instance uuid e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:37:56.202803 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:56.212968 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8244c276-e623-407e-bab8-04337a71a94e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1259 microversion: 2.1 time: 0.228691 May 27 03:37:56.221340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 164/315] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:55 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:56.221340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:56.221340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:56.226784 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.227358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.228402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.228919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.403333 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:56.411990 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-10ed7f5a-ef70-4e87-a7d3-fef0a06502fe tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.196435 May 27 03:37:56.419125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 165/316] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:56 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:56.540644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-20242b2f-b810-4c43-9220-0e5561582bb6 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/action" status: 200 len: 32 microversion: 2.1 time: 0.495620 May 27 03:37:56.541758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 152/317] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:37:56 2022] POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/action => generated 32 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:37:56.556362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:56.557705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:56.566155 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.566994 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.568131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:56.571239 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:56.785182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:56.796244 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b2a4dd63-584d-410c-bcfe-75b27f9a20d4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.246122 May 27 03:37:56.803441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 166/318] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:56 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:57.015109 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:57.016372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:57.027758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.028587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.029931 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.030567 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.035163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:57.196605 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:57.205293 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:57.206811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:57.208032 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5885cfb6-6796-43a8-83aa-7bd0de9d4fb5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1753 microversion: 2.20 time: 0.199865 May 27 03:37:57.208601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 153/319] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:57 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:57.231176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:57.231790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:57.238085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.238720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.240160 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.240707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.435608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:57.436831 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:57.437328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:57.449780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.450234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.453120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-38001115-de6b-4b36-948b-54ca2af7ef2e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1443 microversion: 2.1 time: 0.224158 May 27 03:37:57.453237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.453237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.460745 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 167/320] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:57 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1443 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:57.473396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:57.482102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:57.482102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.482890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.483901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.484772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.681502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:57.686228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:57.690984 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7263b41d-e6d3-45a2-b783-8cd94349c35f tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.259417 May 27 03:37:57.691579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 154/321] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:57 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:57.694380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3e03ebf8-1126-4df5-a4c2-4f589ca2c112 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1443 microversion: 2.1 time: 0.226272 May 27 03:37:57.694973 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 168/322] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:57 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:37:57.825879 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:57.826506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:57.853400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.853400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:57.853400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:57.853400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:58.156017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:58.166585 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d007882f-b0eb-4977-bd9f-7e091f1c6fe9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.345003 May 27 03:37:58.167863 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 155/323] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:57 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:58.227851 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:58.228555 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:58.239424 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:58.240071 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:58.240749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:58.241198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:58.709347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:58.711311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:58.719058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:58.728327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:58.728853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:58.730892 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:58.734051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:58.744189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:58.747123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:58.752356 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-be98381f-0df9-44f2-a0a0-2b6b4518e018 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1753 microversion: 2.20 time: 0.529232 May 27 03:37:58.753141 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 169/324] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:58 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1753 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:59.178261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:59.185936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:59.186557 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:59.190064 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d95f7a52-485b-4ddd-aef9-f4d307992b61 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.484932 May 27 03:37:59.191513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 156/325] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:58 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:59.209374 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:59.209843 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:59.210637 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:59.211092 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:59.501270 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:37:59.512944 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-31e37f7f-669a-4d3c-8781-79b3e0c74e40 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.331730 May 27 03:37:59.514165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 170/326] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:37:59 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:37:59.772395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:59.774236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:37:59.785411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:59.789635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:37:59.790441 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:37:59.792570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:00.113853 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:00.138160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:00.143344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:00.144579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-32ae7a8b-dd8f-4ee9-9c49-f1234641be30 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.377501 May 27 03:38:00.145181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 157/327] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:37:59 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:00.209733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:00.210482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:00.220630 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:00.221084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:00.223808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:00.226248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:00.533104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:00.534341 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:00.547194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:00.553971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:00.556115 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:00.562331 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:00.686406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:00.712800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e26747e6-1f54-48cc-9ff8-cc36bc81d127 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.493397 May 27 03:38:00.712800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 171/328] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:00 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:00.967128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:00.983955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75066f5e-9ebb-42d2-8d61-69584205a155 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.456291 May 27 03:38:00.984549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 158/329] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:00 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:01.168358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:01.169245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:01.184417 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:01.186531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:01.187456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:01.187898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:01.250469 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:01.755367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:01.755367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:01.755367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:01.755367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:01.756261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:01.756261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:02.117409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:02.133697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:02.135817 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:02.138117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-56b53142-9797-405d-96eb-b3d7defea47c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.973487 May 27 03:38:02.139026 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 172/330] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:01 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:02.144382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:02.145901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:02.152513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:02.153265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:02.154272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:02.155284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:02.226312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:02.226312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6599c2ef-c890-44ef-a62b-568508308e82 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.494776 May 27 03:38:02.226312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 159/331] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:01 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:02.341954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:02.349690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4a4b4cb2-62e5-4cdb-806d-95bd9a64af60 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.209497 May 27 03:38:02.350341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 173/332] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:02 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:02.553982 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-c3e74bc5-72f5-4b17-be9d-b383de31e4e9 req-9cf930a3-3738-48af-9399-3199af389f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:02.562511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c3e74bc5-72f5-4b17-be9d-b383de31e4e9 req-9cf930a3-3738-48af-9399-3199af389f1d service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:02.562987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c3e74bc5-72f5-4b17-be9d-b383de31e4e9 req-9cf930a3-3738-48af-9399-3199af389f1d service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:02.574541 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-c3e74bc5-72f5-4b17-be9d-b383de31e4e9 req-9cf930a3-3738-48af-9399-3199af389f1d service nova] Creating event network-changed:0aa36f0b-ffa2-488e-b031-21fe9c191622 for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 on hv-cinder-82880 May 27 03:38:02.579933 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-c3e74bc5-72f5-4b17-be9d-b383de31e4e9 req-9cf930a3-3738-48af-9399-3199af389f1d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030285 May 27 03:38:02.580527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 160/333] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:03.042427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-f4f870f1-eae5-4684-81d7-f79ec1a12dda req-4b3d2708-48a6-41ab-9441-3c6a5f7f4411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89", "name": "network-vif-plugged", "status": "completed", "tag": "06e71513-08ad-4d96-80b8-50c5d5424f74"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:03.060448 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-f4f870f1-eae5-4684-81d7-f79ec1a12dda req-4b3d2708-48a6-41ab-9441-3c6a5f7f4411 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.064882 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-f4f870f1-eae5-4684-81d7-f79ec1a12dda req-4b3d2708-48a6-41ab-9441-3c6a5f7f4411 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.106341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-f4f870f1-eae5-4684-81d7-f79ec1a12dda req-4b3d2708-48a6-41ab-9441-3c6a5f7f4411 service nova] Creating event network-vif-plugged:06e71513-08ad-4d96-80b8-50c5d5424f74 for instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 on hv-cinder-82880 May 27 03:38:03.118873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-f4f870f1-eae5-4684-81d7-f79ec1a12dda req-4b3d2708-48a6-41ab-9441-3c6a5f7f4411 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081348 May 27 03:38:03.119785 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 174/334] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:03.159448 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:03.160253 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:03.176348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.177604 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.178689 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.179498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.231564 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:03.235085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:03.244191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.250373 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.252322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.252954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.690618 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:03.704775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:03.710871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:03.714756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-219be6e9-222f-4fac-86e4-32795a54c307 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.559610 May 27 03:38:03.716636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 161/335] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:03 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:03.726390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:03.729325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:03.741401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:03.746000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.746511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.748461 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:03.748923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:03.749742 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f9394a1e-cd67-4e31-9d04-6451c83faf25 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.522385 May 27 03:38:03.755879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 175/336] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:03 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:04.022541 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:04.041400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-91a9f777-1107-4ef5-98aa-c7dcee0e0c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.323498 May 27 03:38:04.042230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 162/337] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:03 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:04.753336 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:04.754687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:04.761142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:04.761823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:04.762756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:04.763354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:04.776050 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:04.776675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:04.791244 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:04.794960 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:04.795970 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:04.805252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:05.031586 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:05.041531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3ce7ef53-b6cf-4ee5-bed2-c21c7fd4c976 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.273528 May 27 03:38:05.042630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 163/338] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:04 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:05.047565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:05.058738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:05.059445 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:05.066047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:05.068588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:05.070000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:05.070245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b9b44774-f5b1-45c4-a6d7-859fbb5bc7f0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.340214 May 27 03:38:05.070461 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:05.083366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:05.083366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:05.086049 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 176/339] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:04 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:05.243704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:05.253078 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-700d42c5-e56b-40f4-83f5-2cac1e3c06e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.198233 May 27 03:38:05.275521 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 164/340] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:05 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:06.057638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:06.058513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:06.065232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:06.065680 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:06.066444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:06.066901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:06.089665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:06.090281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:06.097612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:06.098073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:06.099441 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:06.099885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:06.286197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:06.289318 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:06.295252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:06.296838 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:06.297165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e0174e76-6d8e-4487-b9c1-ffb210420ebc tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.243474 May 27 03:38:06.297734 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 177/341] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:06 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:06.298204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-940ec054-5196-467a-b174-e1585a47a8ef tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.212383 May 27 03:38:06.303203 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 165/342] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:06 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:38:06.303405 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:06.303405 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:06.308429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:06.308878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:06.309633 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:06.310072 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:06.466373 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:06.474185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-81b4f17b-fd7a-41af-a79c-2a491662d3c5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.175512 May 27 03:38:06.474747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 178/343] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:06 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:07.313424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:07.314309 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:07.317945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:07.318437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:07.326606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:07.326860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:07.329991 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:07.338012 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:07.338214 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:07.338304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:07.338304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:07.338304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:07.628241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:07.640174 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:07.645485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:07.651765 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0ee80231-d0ce-46a0-8d8c-d2c46957e8b1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.332323 May 27 03:38:07.651765 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 179/344] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:07 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:38:07.653852 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:07.662263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f3540e2-6ce9-492e-9b23-e7f701494b62 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.352577 May 27 03:38:07.664413 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:07.665033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:07.671452 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:07.681238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:07.681238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:07.681238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:07.682269 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 166/345] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:07 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:07.848509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:07.860017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dea36c4f-5a78-424d-9a8b-2f27c8a12fc8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.206152 May 27 03:38:07.874972 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 180/346] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:07 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:08.680304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:08.680895 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:08.689662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:08.690346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:08.702652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:08.703135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:08.704183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:08.704619 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:08.707249 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:08.709951 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:08.710403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:08.711222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:08.711655 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.032208 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:09.040861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ec748229-b1e5-4aa1-bf9b-80d13fd1bb40 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.355049 May 27 03:38:09.044793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 181/347] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:08 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:09.071437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:09.072086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:09.078861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.079318 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.080164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.080769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.116023 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:09.125733 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:09.135121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:09.136404 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-72ae0648-a077-4ba9-8b08-cf977fab53fc tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.471003 May 27 03:38:09.148240 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 167/348] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:08 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:09.266873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:09.288008 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ff340fac-7234-48b4-9404-8debef7bbcaf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.242115 May 27 03:38:09.298276 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 182/349] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:09 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:09.597219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:09.597725 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:09.605410 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.605959 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.606696 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.607213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.633485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-45a3965c-f0ef-45fe-8e92-358c1f67246c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/ips" status: 200 len: 150 microversion: 2.1 time: 0.040219 May 27 03:38:09.634066 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 168/350] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:38:09 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:09.645540 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "545624ea-8813-4f0f-9729-0752e8ba9cde"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:09.646664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:09.652926 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.653372 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.654125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.654557 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.746223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Invalid volume: volume 545624ea-8813-4f0f-9729-0752e8ba9cde is already attached to instances: 79319ab8-3b21-4189-af20-8295ec40a10b May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/os-volume_attachments HTTP/1.1 May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 74 May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:38:09.748081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {"volumeAttachment": {"volumeId": "545624ea-8813-4f0f-9729-0752e8ba9cde"}} May 27 03:38:09.749607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Invalid volume: volume 545624ea-8813-4f0f-9729-0752e8ba9cde is already attached to instances: 79319ab8-3b21-4189-af20-8295ec40a10b May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'server_id': 'cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1', 'body': {'volumeAttachment': {'volumeId': '545624ea-8813-4f0f-9729-0752e8ba9cde'}}} May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 545624ea-8813-4f0f-9729-0752e8ba9cde is already attached to instances: 79319ab8-3b21-4189-af20-8295ec40a10b May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:09.750518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 545624ea-8813-4f0f-9729-0752e8ba9cde is already attached to instances: 79319ab8-3b21-4189-af20-8295ec40a10b May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:09.751952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 545624ea-8813-4f0f-9729-0752e8ba9cde is already attached to instances: 79319ab8-3b21-4189-af20-8295ec40a10b May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 400 to user: Invalid volume: volume 545624ea-8813-4f0f-9729-0752e8ba9cde is already attached to instances: 79319ab8-3b21-4189-af20-8295ec40a10b {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ab2dd42e-d7b7-4430-9b90-7b178fc5aba6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108150 May 27 03:38:09.753379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 183/351] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:38:09 2022] POST /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:38:09.759344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:09.759975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:09.766508 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.766976 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.767735 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:09.768162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:09.796451 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:38:09.831906 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:10.071254 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:10.072752 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:10.073819 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:10.079723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.080173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.080940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.081365 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.214207 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:10.221929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f610db23-3bcc-4d08-878f-7b860d52b00b tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1314 microversion: 2.1 time: 0.154561 May 27 03:38:10.222488 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 184/352] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:10 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:10.227156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:10.227746 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:10.233356 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.233797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.234929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.235363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.465418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:10.476160 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:10.478165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:10.479699 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e7c041c1-5eb9-4fcc-bf0b-81da8f2f99fb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.256107 May 27 03:38:10.493613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 185/353] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:10 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:10.500700 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:10.501382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:10.508854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.509828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.510905 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.511557 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.538817 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-152abcec-7054-4320-b94e-ad5c95f29360 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 204 len: 0 microversion: 2.1 time: 0.782108 May 27 03:38:10.539468 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 169/354] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:38:09 2022] DELETE /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:38:10.552893 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:10.554174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:10.564068 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.564774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.565812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:10.566550 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:10.777689 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:10.790338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cf574ee7-03d9-4820-94da-b26fbd272358 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.294545 May 27 03:38:10.794151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 186/355] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:10 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:10.813704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:10.821612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d7aba280-518e-4773-83c4-8c92ad376113 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.277431 May 27 03:38:10.839073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 170/356] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:10 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:11.239832 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:11.240873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:11.247253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:11.247710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:11.248585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:11.249025 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:11.429152 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:11.437335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-38e852e6-64e3-4a84-a494-cb0282b4da71 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1498 microversion: 2.1 time: 0.202182 May 27 03:38:11.460310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 187/357] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:11 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:11.505225 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:11.508104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-67646183-c714-46c9-b1c0-b4060ff2eade tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Action: 'create', calling method: .version_select at 0x7f304695f280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1485130258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKznpZbc7fOOzKGLEdyW37kqnumsCu6heus2W+B7u9dH4lAB0UUdN/UwJBnYnDXDxgU7RSas6JYfkHoqKjtOgtet5+jqtiX5Rr8kxwpsXDsfdFbdce212+70tl0HO0jrrQ=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:11.511750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:11.523287 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:11.523827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:11.526092 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:11.527383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:11.532846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-67646183-c714-46c9-b1c0-b4060ff2eade tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Getting quotas for project 99d82d4c868f404e9bc7e932aadf7670. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:38:11.536875 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-67646183-c714-46c9-b1c0-b4060ff2eade tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Getting quotas for user c81a63ee15d843bfb857a7f3148015e8 and project 99d82d4c868f404e9bc7e932aadf7670. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:38:11.670796 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-67646183-c714-46c9-b1c0-b4060ff2eade tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.173244 May 27 03:38:11.672546 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 171/358] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:38:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:11.708514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:11.717917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:11.719528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:11.720703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3273bb00-6eb7-49a2-8e50-aecb07362ae8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.222516 May 27 03:38:11.721299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 188/359] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:11 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:11.779424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-333106322", "imageRef": "ea8c3a35-52a6-4c3e-8528-2adde8071749", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1485130258", "networks": [{"uuid": "db24d3e5-88d8-4487-b5a4-91bc1ed45182"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:11.810969 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:11.811583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:11.822111 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:11.822570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:11.823393 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:11.823847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:11.845985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] validate_networks() for [('db24d3e5-88d8-4487-b5a4-91bc1ed45182', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:38:12.043956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:12.048373 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:12.053863 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4c534ef9-abdb-45c5-b032-ca9e1f157d20 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.247029 May 27 03:38:12.054442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 189/360] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:11 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:12.061226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:12.061226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:12.065415 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.065872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.066636 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.067150 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.314654 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:12.323016 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e91d86ab-c042-417d-94a6-dce446f4c299 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.267450 May 27 03:38:12.323609 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 190/361] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:12 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:12.428302 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:38:12.428785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:38:12.429259 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:38:12.429748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:38:12.430077 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:38:12.439525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.440269 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.441087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.441525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.461193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Getting quotas for project 99d82d4c868f404e9bc7e932aadf7670. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:38:12.465655 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Getting quotas for user c81a63ee15d843bfb857a7f3148015e8 and project 99d82d4c868f404e9bc7e932aadf7670. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:38:12.478072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:38:12.480732 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ea8c3a35-52a6-4c3e-8528-2adde8071749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:38:12.572890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:12.573310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:12.580191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.580648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.581425 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.581864 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.605898 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0a2beb61-5bca-4cd7-b19f-84cc6a2955dc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830894 May 27 03:38:12.607048 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 172/362] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:38:12.612684 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:38:12.617706 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ca8628c2-88ec-41b2-89b5-b7a30fb89781 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:12.618313 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ca8628c2-88ec-41b2-89b5-b7a30fb89781 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:12.705124 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ca8628c2-88ec-41b2-89b5-b7a30fb89781 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:12.722225 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ca8628c2-88ec-41b2-89b5-b7a30fb89781 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1258 microversion: 2.1 time: 0.108186 May 27 03:38:12.725339 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 173/363] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:12 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1258 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:12.739711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:12.740443 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:12.748971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.749563 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.750448 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.750984 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.906282 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:12.917330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4ef9bf0f-1b28-4f92-a7e2-f74308b464ad tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 204 len: 0 microversion: 2.1 time: 0.348215 May 27 03:38:12.918824 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:12.919007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 191/364] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:38:12 2022] DELETE /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:38:12.919115 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:12.920196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75f8da56-fb23-4bf2-8ec8-bbe62e862d07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.185518 May 27 03:38:12.920746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 174/365] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:12 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:38:12.927188 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:12.927888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:12.934576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.935068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:12.935837 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:12.936273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:13.072278 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:13.079471 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:13.085974 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:13.087871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:13.088424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:13.089228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:13.089669 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:13.094254 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c8aada56-d848-4d65-baec-08eed7aa57ba tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1504 microversion: 2.1 time: 0.171649 May 27 03:38:13.095456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 192/366] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:12 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:13.230390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:13.237917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-030442fd-fa6c-47f9-b69e-18f24f41df14 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.170697 May 27 03:38:13.238490 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 175/367] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:13 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:13.341631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:13.342199 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:13.350579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:13.351100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:13.351926 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:13.352365 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:13.505671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:13.515073 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-03bff6da-298c-4ef6-a44c-04ad5a53beab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.177283 May 27 03:38:13.515663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 193/368] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:13 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:13.741197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2a7d8af0-651f-44f5-af5b-77e285224528 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:13.741804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2a7d8af0-651f-44f5-af5b-77e285224528 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:13.802692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2a7d8af0-651f-44f5-af5b-77e285224528 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:13.810393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2a7d8af0-651f-44f5-af5b-77e285224528 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1258 microversion: 2.1 time: 0.073046 May 27 03:38:13.812062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 176/369] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:13 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:13.939148 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:13.939825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:13.947189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:13.947776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:13.948647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:13.949416 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.084953 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.094797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.096658 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.098756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8209b4de-9b87-4c7b-98d7-1d5574719626 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.163224 May 27 03:38:14.099883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 194/370] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:13 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:14.112497 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:14.113803 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:14.121454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.121899 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.122665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.123118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.255529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:14.256538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:14.263120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.263450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.264096 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.264887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.265490 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.271189 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-beb90246-c92e-45e4-9a12-28ce857e6090 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1504 microversion: 2.1 time: 0.162503 May 27 03:38:14.271765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 177/371] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:14 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:14.398018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.405041 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dbc27ffd-1ce5-4ae3-b1d5-44664449b2b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.153619 May 27 03:38:14.405619 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 195/372] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:14 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:14.533252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:14.533855 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:14.540495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.540940 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.541696 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.542127 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.679447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.686972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7b10964a-3153-47e4-9736-7c2c49568263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.157568 May 27 03:38:14.687534 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 178/373] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:14 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:14.827470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:14.828080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:14.835043 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.835518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.836274 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:14.836708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:14.896143 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:14.903495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5815cf21-5b20-4048-b859-c74a4bf5abc9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1262 microversion: 2.1 time: 0.079897 May 27 03:38:14.904065 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 196/374] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:14 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:15.117494 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:15.118095 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:15.124554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.124997 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.125747 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.126176 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.250955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.259298 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.260896 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.262044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dec244a9-f569-4f2e-baf8-295b905d28e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.148473 May 27 03:38:15.270562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 179/375] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:15 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:15.287927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:15.288535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:15.295035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.295483 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.296241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.296675 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.422274 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:15.422910 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:15.423317 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.429011 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.429460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.430218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.430649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.430883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d1a7a103-0ba9-4cb4-9e8f-ba675503f974 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1504 microversion: 2.1 time: 0.147361 May 27 03:38:15.431456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 197/376] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:15 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:15.556750 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.564167 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-31d5403a-8d0e-4e9d-8e97-36c8893e4a5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.145768 May 27 03:38:15.569564 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 180/377] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:15 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:15.705010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:15.705548 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:15.711779 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.712232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.718346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.718346 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.842710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.850800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6d47ab2f-70c3-4650-8520-7449d8f94d87 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.149967 May 27 03:38:15.851402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 198/378] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:15 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:15.920625 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:15.921256 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:15.927355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.927803 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.928589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:15.929025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:15.986910 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:15.994325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d250cd11-d785-45da-b516-28c4da555d7f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1262 microversion: 2.1 time: 0.077564 May 27 03:38:15.994914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 181/379] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:15 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:16.281363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:16.281883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:16.288801 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.289374 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.289981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.290419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.419902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:16.429083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:16.430605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:16.431795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-489fb640-a259-454d-b605-119c563f3b64 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.154429 May 27 03:38:16.432366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 199/380] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:16 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:16.448499 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:16.449107 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:16.456419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.456871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.457716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.458162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.585366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:16.586081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:16.589218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:16.592741 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.592893 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.593732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.594238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.596728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aadabbc5-3e30-404b-ac9a-ad5d3d521a34 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1504 microversion: 2.1 time: 0.152526 May 27 03:38:16.597297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 182/381] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:16 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:16.720281 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:16.728401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-65499682-662b-4cd5-8e26-d02729a77d76 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.147440 May 27 03:38:16.728991 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 200/382] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:16 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:16.874464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:16.874464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:16.874464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.874923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:16.875684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:16.876121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.001173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.009690 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fc82a20a-c2a5-426b-9990-4cd735166a1f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.146105 May 27 03:38:17.010261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 183/383] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:16 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:17.011421 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:17.012037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:17.017978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.018429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.023545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.023545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.082001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.090133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8aaf4371-b7a7-49c8-83dc-2e2c893c4cdb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1262 microversion: 2.1 time: 0.082752 May 27 03:38:17.090701 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 201/384] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:17 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:17.450193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:17.450828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:17.457635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.458117 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.458956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.459395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.587594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.596219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.597724 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.599022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-57c0d0e8-c019-4191-ac74-75100d7cad80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.152735 May 27 03:38:17.599581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 184/385] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:17 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:17.613467 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:17.614600 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:17.621039 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.621491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.622249 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.622687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.745697 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:17.746317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:17.747209 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.752935 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.760087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.760087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:17.760087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:17.760428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d111b963-f193-4312-812c-201facddab9e tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1504 microversion: 2.1 time: 0.145731 May 27 03:38:17.760428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 202/386] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:17 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:17.888275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:17.901480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9b683715-a005-4730-b378-9c185d51c2e0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.155471 May 27 03:38:17.901480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 185/387] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:17 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:18.027037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:18.027567 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:18.033612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.034051 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.034800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.035259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.106803 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:18.107651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:18.114441 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.115467 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.116204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.116692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.203666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:18.206491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:18.212317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dd52a035-5694-4a5e-97d9-a10ae5f86d8b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1254 microversion: 2.1 time: 0.109612 May 27 03:38:18.218801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 186/388] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:18 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1254 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:18.218975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4b092a32-8839-407c-a8ac-1f10b45dca18 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.191094 May 27 03:38:18.218975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 203/389] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:18 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:18.618560 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:18.619271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:18.626308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.626808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.627689 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.628132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.763660 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:18.773048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:18.773702 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:18.774507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:18.776183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:18.777364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-783f8d7d-4247-43da-b693-2662349543ba tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.163591 May 27 03:38:18.788248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 187/390] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:18 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:18.788429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.788429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.788429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.788429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.915501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:18.916027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:18.922336 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.922695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.924833 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:18.925444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:18.951241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:18.955469 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:18.961382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-761a00bb-794d-4918-b49a-b66c78b37b37 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1504 microversion: 2.1 time: 0.192634 May 27 03:38:18.970360 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 204/391] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:18 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:19.058233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:19.065985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c7a0f640-3443-4b7d-b6d6-c13d9af89ede tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.156045 May 27 03:38:19.066773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 188/392] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:18 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:19.229733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:19.235911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:19.236042 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:19.236042 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:19.239998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.240254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.240744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.240859 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.241531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.241638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.241964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.242085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.261941 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:19.339218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:19.347210 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ccf510e8-9378-4df6-b200-625073498951 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1310 microversion: 2.1 time: 0.121258 May 27 03:38:19.357173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 205/393] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:19 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1310 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:19.402801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:19.411743 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7264e101-3ed1-4cc9-bc32-a77c0d40f49c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1681 microversion: 2.1 time: 0.184246 May 27 03:38:19.412392 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 189/394] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:19 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:19.621116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-6401e168-31d8-4518-9180-f9a2d9fc006a req-8e62a484-33ba-4f6c-9cb3-3378bf804794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89", "name": "network-vif-deleted", "tag": "06e71513-08ad-4d96-80b8-50c5d5424f74"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:19.630121 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6401e168-31d8-4518-9180-f9a2d9fc006a req-8e62a484-33ba-4f6c-9cb3-3378bf804794 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.630824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-6401e168-31d8-4518-9180-f9a2d9fc006a req-8e62a484-33ba-4f6c-9cb3-3378bf804794 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.648047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-6401e168-31d8-4518-9180-f9a2d9fc006a req-8e62a484-33ba-4f6c-9cb3-3378bf804794 service nova] Creating event network-vif-deleted:06e71513-08ad-4d96-80b8-50c5d5424f74 for instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 on hv-cinder-82880 May 27 03:38:19.648047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-6401e168-31d8-4518-9180-f9a2d9fc006a req-8e62a484-33ba-4f6c-9cb3-3378bf804794 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 May 27 03:38:19.648639 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 206/395] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:19.797355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:19.797940 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:19.805712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.806170 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.806995 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.807460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.950773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:19.960450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:19.963843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:19.963843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-03c6b77c-704b-44cc-88ef-79fd6a774425 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.171831 May 27 03:38:19.964283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 190/396] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:19 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:19.980676 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:19.982092 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:19.996354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:19.998179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:19.999359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.000024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.089153 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:20.090009 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:20.100213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.103239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.109056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.116678 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.250350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:20.262096 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-16f949cf-ab87-490e-b01d-b1585855ad1c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1462 microversion: 2.1 time: 0.286170 May 27 03:38:20.292367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 207/397] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:19 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1462 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:20.368168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:20.369037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:20.377080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.386367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.386367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.386367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.465307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:20.483728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:20.483728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-53b13967-4ef3-461a-ac10-6681a52309b8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.396593 May 27 03:38:20.484116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0afc98f1-98cc-409c-a69b-edb2633f9843 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1310 microversion: 2.1 time: 0.114657 May 27 03:38:20.484358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 191/399] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:20 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:20.484459 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 208/399] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:20 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1310 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:20.484565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:20.484565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:20.488339 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.488824 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.489602 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.490029 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.523689 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.524058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.524516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'fault' on Instance uuid cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:20.567396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:20.574997 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6934c2c1-31bd-4a16-8d4f-2a6cd04895ab tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1330 microversion: 2.1 time: 0.096836 May 27 03:38:20.575573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 192/400] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:20 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:20.983845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:20.984873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:20.992296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.992840 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:20.993692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:20.994201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.180832 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.190492 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.192942 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.194510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-932cdee4-e142-4d2e-9f03-973a71df4f76 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.214630 May 27 03:38:21.195267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 209/401] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:20 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:21.281512 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:21.282112 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:21.288685 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.289128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.289874 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.290300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.321190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.321558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.322047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lazy-loading 'fault' on Instance uuid 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:21.360730 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.368721 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bb74e49a-ba5a-4247-b682-ba9add01bae5 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1304 microversion: 2.1 time: 0.091091 May 27 03:38:21.369285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 193/402] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:21 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:21.501164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:21.502694 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:21.514764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.515263 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.516029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.516467 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.520487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:21.521283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:21.527549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.528000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.528763 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.529200 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.607954 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.616850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3d7796be-c99c-43a0-863f-713fb047948a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1310 microversion: 2.1 time: 0.107459 May 27 03:38:21.618433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 194/403] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:21 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:21.623903 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:21.625419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:21.632565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.633609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.634571 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.635049 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.676640 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.677218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.677678 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'fault' on Instance uuid cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:21.751325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.760349 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-702886d2-205f-4bb9-8ba7-3e353153da06 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1330 microversion: 2.1 time: 0.140555 May 27 03:38:21.770133 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 195/404] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:21 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:21.770133 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-0876f1e5-c039-4d33-ab8e-c0426ba3a98a req-c289cd17-96e0-4759-a7ee-af3927e00db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1", "name": "network-vif-deleted", "tag": "56827ab0-a142-44a1-9dc8-40a1076ef828"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:21.771837 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:21.776261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-0876f1e5-c039-4d33-ab8e-c0426ba3a98a req-c289cd17-96e0-4759-a7ee-af3927e00db3 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:21.776708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-0876f1e5-c039-4d33-ab8e-c0426ba3a98a req-c289cd17-96e0-4759-a7ee-af3927e00db3 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:21.782648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:21.790181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-0876f1e5-c039-4d33-ab8e-c0426ba3a98a req-c289cd17-96e0-4759-a7ee-af3927e00db3 service nova] Creating event network-vif-deleted:56827ab0-a142-44a1-9dc8-40a1076ef828 for instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 on hv-cinder-82880 May 27 03:38:21.795825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bd47e29a-c33d-4999-b135-8f4ac64ddfce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.296147 May 27 03:38:21.799366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-0876f1e5-c039-4d33-ab8e-c0426ba3a98a req-c289cd17-96e0-4759-a7ee-af3927e00db3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 May 27 03:38:21.799366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 196/405] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:21.799577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 210/406] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:21 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:22.214405 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:22.215126 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:22.222122 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.222569 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.223868 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.224288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.378447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.386228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:22.388246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.390073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.391489 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-57e24548-ec8c-4f55-852c-b11d19db7ab6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.181695 May 27 03:38:22.392556 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 197/407] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:22 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:22.407116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:22.412475 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.413163 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.414017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.414454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.447502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.447944 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.448397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lazy-loading 'fault' on Instance uuid 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:22.488104 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.495647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-03605e94-d750-4e88-ad69-7c9e85a476b8 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1304 microversion: 2.1 time: 0.113835 May 27 03:38:22.496223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 211/408] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:22 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:22.631165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:22.635430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:22.641078 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:22.643039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.643560 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.644393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.644895 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.714863 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.722260 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4ac13c59-7448-407a-9293-faead61cd282 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1310 microversion: 2.1 time: 0.092065 May 27 03:38:22.722893 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 198/409] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:22 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:22.777408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:22.778014 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:22.784091 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.784605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.785443 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.785883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.815203 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:22.815811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:22.818578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.819062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.819508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'fault' on Instance uuid cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:22.822624 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.823104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.823866 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.824310 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.863320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.871477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-028ca989-d1dd-4fd0-9d0a-6f8fcb89fa85 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 200 len: 1330 microversion: 2.1 time: 0.097766 May 27 03:38:22.872055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 212/410] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:22 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:22.962702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:22.968993 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b5832779-eed0-4d6c-bd74-97da42cc9d65 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1503 microversion: 2.1 time: 0.157725 May 27 03:38:22.969561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 199/411] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:22 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:22.986091 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9bc360c-d500-427e-a472-7ebf6e87bc09"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:22.987244 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:22.993847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.994292 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:22.995074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:22.995538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.019362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] HTTP exception thrown: Cannot 'attach_volume' instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 while it is in vm_state rescued May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Request method failure captured: May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/os-volume_attachments HTTP/1.1 May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 74 May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEdJle72uA52wRzl38Wo43jLfBUD8_6-W2I-TixspRM8trW4-_2haG8mfc5F9L3Xi5Bqj3rHIho7SA8IGXv5IHFoJA36ducSbafluUVIdz287TsaM13us68tDUJkPJf9fZzmKloTmtdMm-Skgg0llpRkAvVz2pqCiat4SA7MX--FAis May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:38:23.021050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_03b1335715234895a0c1a555b22ee8d3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/03b1335715234895a0c1a555b22ee8d3"}]}] May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: b2671aaae84644acb89c3c3595bb5673 May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {"volumeAttachment": {"volumeId": "f9bc360c-d500-427e-a472-7ebf6e87bc09"}} May 27 03:38:23.022918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Cannot 'attach_volume' instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 while it is in vm_state rescued May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'server_id': 'e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822', 'body': {'volumeAttachment': {'volumeId': 'f9bc360c-d500-427e-a472-7ebf6e87bc09'}}} May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:38:23.029286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 while it is in vm_state rescued May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:23.031031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 while it is in vm_state rescued May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Returning 409 to user: Cannot 'attach_volume' instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 while it is in vm_state rescued {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-835355b8-9ce8-41e0-b5d1-7725ea36dfb7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040528 May 27 03:38:23.032795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 213/412] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:38:22 2022] POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 03:38:23.036723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:23.037253 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:23.043494 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.043934 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.044698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.045132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.380232 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f63f3127-6fa3-4803-ae91-60ea7e3eb272 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/action" status: 202 len: 0 microversion: 2.1 time: 0.351754 May 27 03:38:23.380964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 200/413] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:38:23 2022] POST /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:38:23.388923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:23.389529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:23.395661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.396115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.396966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.397403 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.410315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:23.411058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:23.417435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.417974 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.418748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.419208 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.697139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:23.701319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:23.712559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:23.714326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:23.714604 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4e3ad3ce-339a-4b69-ae2e-ca895c5d3f61 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.324259 May 27 03:38:23.715602 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 214/414] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:23 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:23.715864 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2f197b98-e34b-4345-9c57-be92553c03b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.310031 May 27 03:38:23.716554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 201/415] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:23 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:38:23.720448 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:23.725961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:23.736576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.737740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.738709 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.739342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.744586 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:23.745546 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:23.753166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.753698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.755116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.755622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.792322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.793056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.793201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lazy-loading 'fault' on Instance uuid 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:23.807578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=14 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:23.847308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:23.857074 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c3e4a55d-ecd2-4061-b5db-4b4c804d8ecb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1328 microversion: 2.1 time: 0.116923 May 27 03:38:23.860713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 202/416] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:23 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:23.885551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d76f23d7b614fac857a9aefd2d345b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b89ed90acc4dd2aa3bca17bb1a1fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:23.894419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:23.894419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:23.894771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bf6fc1b5-6952-401d-9adc-8aad6c552398 tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 200 len: 1304 microversion: 2.1 time: 0.175774 May 27 03:38:23.894771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 215/417] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:23 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:23.915209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.915209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.915209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:23.915209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:23.931343 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 HTTP/1.1 May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:38:23.932990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:38:23.934337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': 'cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1'} May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:38:23.935118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:38:23.936980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:23.938765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:38:23.938765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3b0f9edb-cb2b-492a-8d24-013bcab800c5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 404 len: 111 microversion: 2.1 time: 0.049922 May 27 03:38:23.938765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 203/418] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:23 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:38:23.943911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-06f9f92c-0c27-412a-9705-0eb446eb1db1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '.version_select at 0x7f30467a0af0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:23.947218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06f9f92c-0c27-412a-9705-0eb446eb1db1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [deebb62f-6ae5-43f5-a9b9-f465fc822abf] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:38:24.733574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:24.735005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:24.745539 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:24.745990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:24.746761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:24.747222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:24.892326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:24.901149 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3b0c5fc2-6a9d-4c98-b69e-47bb8f2996d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.171661 May 27 03:38:24.901714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 204/419] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:24 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:24.906181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:24.907190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:24.915665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:24.916110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:24.916872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:24.917299 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:24.938738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:24.955629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [None req-06f9f92c-0c27-412a-9705-0eb446eb1db1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [deebb62f-6ae5-43f5-a9b9-f465fc822abf] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52750. May 27 03:38:25.035576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-06f9f92c-0c27-412a-9705-0eb446eb1db1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-716719997" status: 202 len: 0 microversion: 2.1 time: 1.095235 May 27 03:38:25.035576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 216/420] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 27 03:38:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-716719997 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:38:25.041808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:25.042797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:25.053076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:25.053585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:25.054405 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:25.054928 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:25.065609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:25.078028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:25.078028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:25.078028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0cc391ef-407e-412d-ac43-6b1b01eb7ce0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.175178 May 27 03:38:25.078867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 205/421] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:24 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:25.095395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:25.096098 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] [instance: 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:25.104870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:25.105912 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:25.106297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:25.107350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:25.125775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] HTTP exception thrown: Instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 could not be found. May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Request method failure captured: May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 HTTP/1.1 May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEdq0FfF82MkVkh0T8pfFXayxelx7oIqrnHqt0q4I5AZE6qrYS_KtpYwFf0Gm3me-IKnZPdlTJLXmgVqekALC5BPYSfUED-bOAjiTA2OMHKNoqQxeJz8KI9-y2gUTTQdFWm4WFL6d7CDl855WqwBlbtaz5_2P4RTWIsVehcL0ZoIGjw May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 09b89ed90acc4dd2aa3bca17bb1a1fe9 May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesActionsTest-1217221362 May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:38:25.127462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_09b89ed90acc4dd2aa3bca17bb1a1fe9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/09b89ed90acc4dd2aa3bca17bb1a1fe9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/09b89ed90acc4dd2aa3bca17bb1a1fe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/09b89ed90acc4dd2aa3bca17bb1a1fe9"}]}] May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesActionsTest-1217221362 May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 09b89ed90acc4dd2aa3bca17bb1a1fe9 May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesActionsTest-1217221362 May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesActionsTest-1217221362-project May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 1d76f23d7b614fac857a9aefd2d345b6 May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesActionsTest-1217221362-project May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 could not be found. May 27 03:38:25.129646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89'} May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 could not be found. May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:38:25.130559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 could not be found. May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 could not be found. May 27 03:38:25.132271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:38:25.136028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] Returning 404 to user: Instance 3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:38:25.136028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d0e61a26-17bd-4250-8382-bc0c1514fc7c tempest-VolumesActionsTest-1217221362 tempest-VolumesActionsTest-1217221362-project] 10.222.0.24 "GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89" status: 404 len: 111 microversion: 2.1 time: 0.043130 May 27 03:38:25.136028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 206/422] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:25 2022] GET /compute/v2.1/servers/3d79d89b-d1bb-4f7d-ba6a-adc8003d8f89 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:38:25.223340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:25.230776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c07c3475-c946-49d3-8517-5dca6963d87a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.193860 May 27 03:38:25.231786 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 217/423] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:25 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:25.922009 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:25.922009 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:25.936005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:25.936465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:25.937446 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:25.938100 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:26.101915 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:26.103021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:26.151596 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:26.152794 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:26.155818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:26.156963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:26.522365 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:26.530491 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-da26158f-fad5-4f1d-b88f-9fe96746e7a9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.615152 May 27 03:38:26.531121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 207/424] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:25 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:26.547256 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:26.555332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:26.558142 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:26.559352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:26.560366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:26.560991 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:26.752773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:26.771182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:26.773850 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:26.775532 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e2561e5f-02d9-4ada-b2ab-017e4fa384ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.681567 May 27 03:38:26.787593 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 218/425] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:26 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:26.875584 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:26.881337 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:26.882363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:26.907221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6cd5e03a-fd04-4926-873f-a67d2c8eb323 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.341196 May 27 03:38:26.907221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 208/426] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:26 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:26.907476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:26.907476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:26.907476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:26.907476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.057780 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'services' on Instance uuid 79319ab8-3b21-4189-af20-8295ec40a10b {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:27.073855 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-71697bb1-b3a0-4994-910e-1e19d6afabae req-dbf1b2b9-fb81-4781-b1f9-3a3832a46fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:27.093606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-71697bb1-b3a0-4994-910e-1e19d6afabae req-dbf1b2b9-fb81-4781-b1f9-3a3832a46fc6 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.095657 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-71697bb1-b3a0-4994-910e-1e19d6afabae req-dbf1b2b9-fb81-4781-b1f9-3a3832a46fc6 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.116110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-71697bb1-b3a0-4994-910e-1e19d6afabae req-dbf1b2b9-fb81-4781-b1f9-3a3832a46fc6 service nova] Creating event network-changed:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:38:27.125998 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-71697bb1-b3a0-4994-910e-1e19d6afabae req-dbf1b2b9-fb81-4781-b1f9-3a3832a46fc6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056160 May 27 03:38:27.129253 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 209/427] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:27.437446 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-80b0dab9-6951-4a3f-9e7b-7b9045d1311e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments/545624ea-8813-4f0f-9729-0752e8ba9cde" status: 202 len: 0 microversion: 2.1 time: 0.561359 May 27 03:38:27.438771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 219/428] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:38:26 2022] DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments/545624ea-8813-4f0f-9729-0752e8ba9cde => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:38:27.447762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:27.448966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:27.456037 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.456926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.458762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.459453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.493743 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c7a52dad-db14-4e4b-96d2-57d138a02ad9 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050360 May 27 03:38:27.499261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 210/429] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:27 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:38:27.550081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:27.551768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:27.563473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.564646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.566226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.567444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.731852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:27.740663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5acffcef-d3fb-457f-a3f4-a824001c27d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.194928 May 27 03:38:27.741260 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 220/430] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:27 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:27.800741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:27.801255 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:27.807985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.808435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.809211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.809646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.934920 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:27.934920 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:27.934920 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.934920 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.935392 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:27.935392 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:27.954549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:27.983377 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:27.985178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:27.986392 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-484d4b8a-6fbe-48b7-ba7e-a436c519e480 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.190069 May 27 03:38:27.987058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 211/431] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:27 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:28.074607 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:28.083587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:28.085084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1f3517a6-cc98-4cc5-ab37-8308e161c6cf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.173642 May 27 03:38:28.093579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 221/432] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:27 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:28.507151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:28.508166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:28.515183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:28.515637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:28.516405 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:28.516867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:28.551311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-73484edd-6821-48e8-b160-e54541182567 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048100 May 27 03:38:28.552434 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 212/433] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:28 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:28.757909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:28.758574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:28.766645 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:28.767123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:28.767906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:28.768378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:28.907175 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:28.915247 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d4c97b7f-5e02-45f5-8301-2de1c24f6a16 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.161484 May 27 03:38:28.915829 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 222/434] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:28 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:29.006163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:29.006765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:29.012949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.013332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.015342 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.015878 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.103126 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:29.103468 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:29.109938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.116592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.116592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.116592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.211084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:29.223476 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:29.225336 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:29.226607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7e50fbd1-6c4b-4ea0-b0fb-01e1a5e837ed tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.224968 May 27 03:38:29.227276 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 213/435] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:29 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:29.278222 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:29.288502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-86c38a5b-35ba-4447-ad85-c7c6c347d0da tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.189607 May 27 03:38:29.289083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 223/436] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:29 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:29.563065 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:29.564735 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:29.571773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.572303 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.573134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.573633 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.606407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-55edb85b-dc38-4819-a3e4-2c72f3c0e09f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047254 May 27 03:38:29.607118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 214/437] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:29 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:29.932935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:29.933605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:29.941873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.942328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:29.943119 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:29.943689 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.073770 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:30.082303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4666733b-a334-4971-b4e1-0429e55c9858 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.153610 May 27 03:38:30.082980 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 224/438] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:29 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:30.245384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:30.246915 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:30.254978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:30.255400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.256441 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:30.256956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.306706 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:30.307442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:30.313934 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:30.314670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.315552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:30.316351 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.451213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:30.463535 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:30.465074 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:30.466251 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd04b9c7-d24c-42fe-843e-7a4b0f182b54 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.224932 May 27 03:38:30.467056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 215/439] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:30 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:30.508783 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:30.516782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1e506292-1e06-4f20-80fa-96c5301a1133 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.213877 May 27 03:38:30.517369 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 225/440] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:30 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:30.618436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:30.620121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:30.626858 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:30.627442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.628204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:30.629396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:30.668062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd3ac3b3-cc7c-4ecf-8146-95c2921c1a2a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053609 May 27 03:38:30.669215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 216/441] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:30 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:31.100095 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:31.100775 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:31.107344 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.107767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.108572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.109010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.260037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:31.268082 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6d66a617-568b-4f7f-8698-1835c5b69d6c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.171996 May 27 03:38:31.268814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 226/442] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:31 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:31.485301 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:31.485928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:31.493084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.493553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.494363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.495071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.533903 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:31.534517 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:31.544571 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:31.554427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.558386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.559890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.563037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.816441 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:31.837454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:31.839498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:31.939517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2b982a29-3152-4cd6-be7b-45dc3810841b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.362481 May 27 03:38:31.939517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 217/443] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:31 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:31.939906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:31.939906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6b1b1dd1-aa4f-4d7e-ab38-19a13cd2f36f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.328229 May 27 03:38:31.940438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:31.940539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 227/444] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:31 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:31.940741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:31.940741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.940741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.940741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:31.941088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:31.941088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1798c3b7-1d17-4fa1-8fa1-d6af36fb172e tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075814 May 27 03:38:31.941088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 218/445] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:31 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:32.286895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:32.287587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:32.303833 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.321215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:32.321215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.321215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:32.523453 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:32.547773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-29245367-4772-42a4-8d76-feadbe02caf9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.255569 May 27 03:38:32.547773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 228/446] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:32 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:32.913604 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-7567eecb-f5ab-48f9-aebe-980b57b01cc2 req-651ca1bc-b5af-4c98-afb3-96f5cef1c96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "name": "network-vif-plugged", "status": "completed", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:32.921133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:32.926972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7567eecb-f5ab-48f9-aebe-980b57b01cc2 req-651ca1bc-b5af-4c98-afb3-96f5cef1c96e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.927135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:32.927227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7567eecb-f5ab-48f9-aebe-980b57b01cc2 req-651ca1bc-b5af-4c98-afb3-96f5cef1c96e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:32.938338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-7567eecb-f5ab-48f9-aebe-980b57b01cc2 req-651ca1bc-b5af-4c98-afb3-96f5cef1c96e service nova] Creating event network-vif-plugged:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:38:32.945402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-7567eecb-f5ab-48f9-aebe-980b57b01cc2 req-651ca1bc-b5af-4c98-afb3-96f5cef1c96e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037952 May 27 03:38:32.946650 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 219/447] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:32.951668 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.953248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:32.954396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:32.955447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:32.956289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.962885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.963467 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:32.964038 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:32.965112 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:32.965756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:33.218940 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:33.233955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:33.241398 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:33.244207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e46d3839-d3e0-4eaf-972d-c93452fc8f7e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.296137 May 27 03:38:33.245514 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 220/448] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:32 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:33.273520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:33.274605 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:33.290923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:33.293217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:33.294269 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:33.294948 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:33.326033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:33.335744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ca6d2e17-b2cb-41f1-b176-d16ab639e666 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.423431 May 27 03:38:33.347186 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 229/449] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:32 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:33.352836 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d42f6635-6619-4341-803c-1785ae10c68d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092436 May 27 03:38:33.353922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 221/450] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:33 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:33.557254 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:33.558000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:33.564904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:33.565689 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:33.566998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:33.567733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:33.744331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:33.752699 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a4dee2b-4d49-40a9-b618-1cff9e12875a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.200362 May 27 03:38:33.753480 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 230/451] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:33 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:34.266369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:34.267230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:34.274908 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.275364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.276153 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.276588 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.354581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:34.355321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:34.362980 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.364028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.364818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.375625 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.465526 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:34.501638 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:34.507384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:34.507384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4b6c328f-b839-49c0-aa72-5254b0549a7a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.242583 May 27 03:38:34.507384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 222/452] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:34 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:34.510734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:34.512352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:34.520254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.520696 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.521459 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.521885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.542938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:34.550709 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-495b6b16-e562-4e12-b7f5-5315ffae1566 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.200490 May 27 03:38:34.557593 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 231/453] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:34 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:34.557728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-08bbd1a0-786a-4841-bba3-90611815003c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048348 May 27 03:38:34.557728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 223/454] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:34 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:34.773937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:34.774980 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:34.792290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.792761 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.793758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:34.793995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:34.964588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:34.980530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-27f0da07-492b-4fe1-9301-f8f8d072dbae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.214668 May 27 03:38:34.981129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 232/455] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:34 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:35.523645 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:35.524297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:35.531358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:35.532462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:35.534047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:35.535324 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:35.543606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:35.570450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:35.573977 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:35.591802 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:35.593094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:35.597588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:35.599878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:35.693299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-727b6846-1c22-4235-972b-2d368fdff564 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129455 May 27 03:38:35.694910 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 233/456] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:35 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:38:35.708382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:35.709230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:35.725443 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:35.726392 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:35.727040 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:35.728190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:35.756354 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:35.767591 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:35.769493 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:35.774148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bf9cbecc-1a63-4dca-94bf-483d48eef6c4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.251473 May 27 03:38:35.778978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 224/457] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:35 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:35.958446 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:35.973424 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5acbca06-e5a6-4712-bd70-4640a293982c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.270392 May 27 03:38:35.985404 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 234/458] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:35 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:36.000017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:36.000628 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:36.014972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:36.015701 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:36.016652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:36.017250 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:36.181115 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:36.200545 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0243e00d-8cfb-4a0e-b945-e5f77112a3cf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.205827 May 27 03:38:36.212195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 225/459] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:35 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:36.706621 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:36.708563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:36.715596 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:36.716142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:36.717036 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:36.717460 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:36.750378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c9d4f417-eaa2-48d5-9d9e-43a6eec906c6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 May 27 03:38:36.755583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 235/460] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:36 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:36.794270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:36.795123 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:36.803893 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:36.804561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:36.805501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:36.805957 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.005909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:37.005909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:37.005909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:37.005909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.045258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:37.045258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.085358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:37.169548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:37.195234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:37.195234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3a183f21-9591-4d25-a5a5-4bb92f974984 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.399715 May 27 03:38:37.216347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 226/461] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:36 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:37.224328 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:37.224932 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:37.232601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:37.233059 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.234132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:37.234771 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.247849 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:37.264278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-db562009-8785-410d-aa5a-f5063c85e9a5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.274750 May 27 03:38:37.274760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 236/462] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:36 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:37.392315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:37.400967 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-44553dea-b85b-454b-9acc-29055de38c43 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1511 microversion: 2.1 time: 0.180947 May 27 03:38:37.414272 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 227/463] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:37 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:37.762749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:37.763747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:37.771007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:37.771441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.772295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:37.772719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:37.802906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-728fa771-6695-47a7-b0aa-0f36e7bbc929 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 May 27 03:38:37.803467 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 237/464] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:37 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:38.219247 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:38.220245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:38.228336 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.228857 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.229720 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.230172 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.282380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:38.283034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:38.290115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.290491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.291581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.292027 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.311818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:38.465631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:38.475328 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:38.477938 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:38.479349 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f7c7ae7c-3237-43f2-acdd-f383e8f59efb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.264062 May 27 03:38:38.483986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 228/465] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:38 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:38.498282 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:38.499352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:38.507750 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.508578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.512676 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.513438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.530408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:38.542476 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a7a41932-a979-42aa-99ad-67793bc08e36 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.263832 May 27 03:38:38.545271 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 238/466] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:38 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:38.729301 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:38.737608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0b280c17-6994-4309-87e6-87af2d64caf7 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1517 microversion: 2.1 time: 0.252124 May 27 03:38:38.738307 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 229/467] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:38 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:38.814863 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:38.817012 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:38.831158 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.832236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.835983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:38.843154 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:38.921911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e7c97c06-1fa8-40d6-81b6-f5d3695d3af4 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111695 May 27 03:38:38.923120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 239/468] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:38 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:39.501707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:39.502625 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:39.520982 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:39.521745 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:39.522788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:39.523452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:39.572315 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:39.573057 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:39.580187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:39.580974 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:39.582001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:39.582504 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.016528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:40.025103 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6b20db19-d563-4e45-b2ed-16193b7eaf77 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.465481 May 27 03:38:40.025774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 240/469] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:39 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:40.032016 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:40.033220 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:40.040023 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:40.040558 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.041384 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:40.041882 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.049840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:40.058620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:40.060240 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:40.061428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-edf71181-3e1d-4707-a577-be9ebcc2c299 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.565267 May 27 03:38:40.062002 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 230/470] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:39 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:40.071795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-618b4185-ec5b-4c1e-b439-5ddb08d0c569 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044925 May 27 03:38:40.072348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 241/471] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:38:40 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:38:40.138708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:40.139252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:40.145779 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:40.146228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.147151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:40.147590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.172053 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:38:40.723600 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6fe46400-13b9-4b74-b371-b149d620983c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 204 len: 0 microversion: 2.1 time: 0.588284 May 27 03:38:40.725185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 231/472] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:38:40 2022] DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:38:40.736105 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:40.739129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:40.749156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:40.750194 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.751985 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:40.752564 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:40.923861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:40.933933 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-83b479ad-89db-4e06-b2b4-03a88c3f4ce7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1682 microversion: 2.1 time: 0.204034 May 27 03:38:40.934966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 242/473] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:40 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:41.042823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:41.043561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:41.051142 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:41.051620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:41.052444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:41.052902 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:41.079838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:41.081720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:41.092083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:41.095293 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:41.096487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:41.097170 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:41.327829 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:41.336117 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6c250742-90ed-4775-825f-d28eb43fa2ca tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.297741 May 27 03:38:41.336716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 232/474] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:41 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:41.344097 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:41.353792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:41.355445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:41.359646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-18b6c9d5-bc77-4446-b572-a974a98c1c33 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.281545 May 27 03:38:41.359646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 243/475] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:41 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:41.491220 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35d97de8-baf8-42ff-897c-31bef0dfe9ab tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'create', calling method: .version_select at 0x7f3046851d30>, body: {"keypair": {"name": "tempest-keypair-243003399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKONfc5nbQc93Dlx/KjF9pRROKQPPXfDn9g0cqMZGlipTIDasTDPGi89cdPCgO26gCJkYnMmCeF+4j9IUBVPqHnU6Kof1B3tbNDwTiMrYbV5wq4AQ+GMN8nD/fkB65+ijA=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:41.511051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-35d97de8-baf8-42ff-897c-31bef0dfe9ab tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for project 03b1335715234895a0c1a555b22ee8d3. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:38:41.515209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-35d97de8-baf8-42ff-897c-31bef0dfe9ab tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for user b2671aaae84644acb89c3c3595bb5673 and project 03b1335715234895a0c1a555b22ee8d3. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:38:41.639400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-35d97de8-baf8-42ff-897c-31bef0dfe9ab tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151829 May 27 03:38:41.645500 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 233/476] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:38:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:41.959191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:41.960259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:41.967970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:41.969510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:41.969510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:41.970238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:42.138597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:42.148002 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fda28238-b16a-46f1-b207-baaa304b4352 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1682 microversion: 2.1 time: 0.200022 May 27 03:38:42.148807 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 244/477] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:41 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:42.352705 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:42.353652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:42.360101 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:42.360843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:42.361793 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:42.362290 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:42.375930 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:42.383385 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:42.399587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:42.400293 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:42.411242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:42.411242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:42.608152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:42.617422 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8d30b62c-5400-482c-a9e9-4a2118f41997 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.268670 May 27 03:38:42.632086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 234/478] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:42 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:42.632261 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:42.638631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:42.641209 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:42.642482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-af812c0b-d92d-4c94-b604-74277252015e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.270418 May 27 03:38:42.643377 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 245/479] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:42 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:43.166217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:43.167054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:43.178978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:43.179589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:43.180517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:43.181238 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:43.408892 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:43.417433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-67f235c5-5483-483f-9234-a65f83e3c174 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1682 microversion: 2.1 time: 0.255065 May 27 03:38:43.418021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 235/480] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:43 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1682 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:43.639661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:43.641380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:43.650240 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:43.650685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:43.651483 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:43.652105 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:43.671350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:43.672536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:43.683331 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:43.684394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:43.685444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:43.686150 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:43.920885 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:43.931949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-88996b4f-4703-45d2-a11f-93f7e3da4977 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.296756 May 27 03:38:43.942024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:43.942493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 246/481] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:43 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:43.948464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:43.950663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:43.952157 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-28f15bbb-b0e6-4aad-8c95-de80a26bca4c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1809 microversion: 2.20 time: 0.287816 May 27 03:38:43.952722 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 236/482] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:43 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:44.434878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:44.435529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:44.442649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:44.443135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:44.443921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:44.444358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:44.619429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:44.628006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3e17beb9-1d4e-43f9-ba05-7f2cb8ebab3d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1682 microversion: 2.1 time: 0.197498 May 27 03:38:44.628643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 247/483] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:44 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:44.666279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-989942033", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ad434bf-5110-4909-8d4e-fd9ddb1876ab"}], "security_groups": [{"name": "tempest-securitygroup--830257851"}], "key_name": "tempest-keypair-243003399", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:44.885073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] validate_networks() for [('7ad434bf-5110-4909-8d4e-fd9ddb1876ab', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:38:44.950597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:44.953315 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:44.962991 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:44.963433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:44.964195 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:44.964867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:45.350464 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:45.363799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d234f20d-0b44-44dc-8593-37e97f4aa9d9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.418234 May 27 03:38:45.365033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 248/484] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:44 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:45.375280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:45.376526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:45.386386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:45.387183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:45.388839 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:45.389296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:45.465397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:45.765086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:45.782098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:45.785996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:45.787767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7770da6f-18b0-4066-b2c8-6517a74b1328 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1796 microversion: 2.20 time: 0.418045 May 27 03:38:45.789134 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 249/485] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:38:45 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1796 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:38:45.796116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:45.797034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:45.808511 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:45.810072 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:45.810979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:45.812109 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:46.197900 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:38:46.198381 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:38:46.198785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:38:46.199223 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:38:46.199641 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:38:46.211088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:46.212187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:46.213270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:46.213921 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:46.236045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for project 03b1335715234895a0c1a555b22ee8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:38:46.242327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Getting quotas for user b2671aaae84644acb89c3c3595bb5673 and project 03b1335715234895a0c1a555b22ee8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:38:46.256840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:38:46.260190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:38:46.309867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:46.319577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b03671d3-8991-4104-bb19-6264327dda7d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1682 microversion: 2.1 time: 0.528940 May 27 03:38:46.329888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 250/486] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:45 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1682 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:46.384766 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:46.385789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:46.393812 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:46.395336 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:46.396871 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:46.397935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:46.472950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-579f4db9-39a4-4591-a2b7-4179f3c5a425 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.810629 May 27 03:38:46.479395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 237/487] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:38:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:38:46.488035 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-de438876-7b9c-49c2-b2cd-c8f320c5f5ff tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:46.499385 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-de438876-7b9c-49c2-b2cd-c8f320c5f5ff tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:46.618990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de438876-7b9c-49c2-b2cd-c8f320c5f5ff tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:46.626918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-de438876-7b9c-49c2-b2cd-c8f320c5f5ff tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1244 microversion: 2.1 time: 0.142803 May 27 03:38:46.642713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 238/488] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:46 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1244 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:46.739440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:46.749366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-833674c4-1025-4178-8223-4763026902ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.371278 May 27 03:38:46.750473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 251/489] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:46 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:47.132123 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-951d98ec-75d6-493d-ae8d-acf81341df83 req-5ff59c9e-cb11-46d6-8baf-96583b22d4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79319ab8-3b21-4189-af20-8295ec40a10b", "name": "network-vif-deleted", "tag": "8c6d464a-a05a-418c-93bf-d261bd71e3e9"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:47.149605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-b5f7359f-4804-4417-a683-f4ea089e99a0 req-e04593af-9fa5-4bac-b538-63e91a656276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "name": "network-vif-plugged", "status": "completed", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:47.154310 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-951d98ec-75d6-493d-ae8d-acf81341df83 req-5ff59c9e-cb11-46d6-8baf-96583b22d4ec service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:47.155583 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-951d98ec-75d6-493d-ae8d-acf81341df83 req-5ff59c9e-cb11-46d6-8baf-96583b22d4ec service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:47.171469 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b5f7359f-4804-4417-a683-f4ea089e99a0 req-e04593af-9fa5-4bac-b538-63e91a656276 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:47.171469 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b5f7359f-4804-4417-a683-f4ea089e99a0 req-e04593af-9fa5-4bac-b538-63e91a656276 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:47.185005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-951d98ec-75d6-493d-ae8d-acf81341df83 req-5ff59c9e-cb11-46d6-8baf-96583b22d4ec service nova] Creating event network-vif-deleted:8c6d464a-a05a-418c-93bf-d261bd71e3e9 for instance 79319ab8-3b21-4189-af20-8295ec40a10b on hv-cinder-82880 May 27 03:38:47.201054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-b5f7359f-4804-4417-a683-f4ea089e99a0 req-e04593af-9fa5-4bac-b538-63e91a656276 service nova] Creating event network-vif-plugged:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:38:47.204826 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-951d98ec-75d6-493d-ae8d-acf81341df83 req-5ff59c9e-cb11-46d6-8baf-96583b22d4ec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076655 May 27 03:38:47.207921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-b5f7359f-4804-4417-a683-f4ea089e99a0 req-e04593af-9fa5-4bac-b538-63e91a656276 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064589 May 27 03:38:47.208717 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 252/490] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:38:47.213326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 239/491] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:47.337963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:47.345077 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:47.351946 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:47.352415 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:47.356825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:47.357298 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:47.467159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:47.479140 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5dc98a5a-964f-4d62-95e6-fc15ea6e65c8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1327 microversion: 2.1 time: 0.144540 May 27 03:38:47.481412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 253/492] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:47 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:47.644703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9d6c64d0-da0a-47b9-bdcc-e14e5da2c797 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:47.645709 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9d6c64d0-da0a-47b9-bdcc-e14e5da2c797 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:47.737467 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9d6c64d0-da0a-47b9-bdcc-e14e5da2c797 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:47.758716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9d6c64d0-da0a-47b9-bdcc-e14e5da2c797 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1244 microversion: 2.1 time: 0.107597 May 27 03:38:47.759359 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 240/493] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:47 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:47.769255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:47.770178 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:47.781474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:47.782294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:47.783342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:47.784061 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:47.959436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:47.973994 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-856349b8-7831-4a91-af75-6795d0df7933 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.208747 May 27 03:38:47.974969 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 254/494] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:47 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:48.501419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:48.502013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:48.535810 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:48.536795 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:48.537905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:48.540064 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:48.602151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:48.602595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:48.603108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'fault' on Instance uuid 79319ab8-3b21-4189-af20-8295ec40a10b {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:38:48.649589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:48.657922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fc4e0cce-717c-4dc8-bb18-f6cd835ac405 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 200 len: 1332 microversion: 2.1 time: 0.162313 May 27 03:38:48.660985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 241/495] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:48 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 1332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:48.766027 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:48.767333 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:48.774737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:48.775257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:48.776037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:48.776500 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:48.843452 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:48.851328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:48.854330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-68bf69ea-f0de-4190-a2c5-cafa21c3c571 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1240 microversion: 2.1 time: 0.092573 May 27 03:38:48.855462 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 255/496] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:48 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:48.992072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:48.992715 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:48.999266 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:48.999722 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:49.000620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:49.001058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:49.150872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:49.159172 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-85d17bc5-336c-41f8-ba54-d258242dc826 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.171012 May 27 03:38:49.159776 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 242/497] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:48 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:49.676093 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:49.676622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:49.682641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:49.683110 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:49.683861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:49.684293 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:49.697938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b HTTP/1.1 May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:38:49.699595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:38:49.701187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '79319ab8-3b21-4189-af20-8295ec40a10b'} May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:38:49.705565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:38:49.706999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:38:49.708230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:38:49.708230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-45fc44f6-4042-4b10-a15e-93b5fa818bce tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 404 len: 111 microversion: 2.1 time: 0.029608 May 27 03:38:49.708230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 256/498] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:49 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:38:49.710227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7187f7b3-86d3-405e-b9c8-1b7b837599c0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '.version_select at 0x7f30468339d0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:49.822990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7187f7b3-86d3-405e-b9c8-1b7b837599c0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267530697" status: 202 len: 0 microversion: 2.1 time: 0.116541 May 27 03:38:49.823583 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 243/499] 10.222.0.24 () {58 vars in 1220 bytes} [Fri May 27 03:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267530697 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:38:49.877565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:49.878230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:49.885520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:49.885966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:49.886754 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:49.887208 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:49.950958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:49.959031 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-07ef4814-626f-420f-8586-2a5a341add44 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1296 microversion: 2.1 time: 0.085332 May 27 03:38:49.959598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 257/500] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:49 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:50.175885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:50.176501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:50.185297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:50.185297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:50.185297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:50.185297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:50.189325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:50.397764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:50.406219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b8c111b0-cf3d-4b21-abf0-460535807bb5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1358 microversion: 2.1 time: 0.234830 May 27 03:38:50.406788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 244/501] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:50 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:50.878129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0074a30e-ec96-4157-a354-0246189be6a2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: .version_select at 0x7f3046846c10>, body: {"keypair": {"name": "tempest-keypair-816668274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOFMa2ybZxYi0ONfaAuDlVqL3OlZy0vcZwNV8GX0a5HdFTpekJN1d7Bg6tX0C3eVJMRp72BWJzusDBuGBeW0OVSwohzUyOAxotaZxGiNldiQY2Oeh0bCXBdy+09Mc5iKA=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:50.893573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-0074a30e-ec96-4157-a354-0246189be6a2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:38:50.898918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-0074a30e-ec96-4157-a354-0246189be6a2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:38:50.977793 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:50.979175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:50.985867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:50.986318 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:50.987116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:50.987549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.017796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0074a30e-ec96-4157-a354-0246189be6a2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143694 May 27 03:38:51.018944 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 258/502] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:38:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:51.064695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:51.073286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-af307273-f4b6-4c08-b96e-f7e41c0fcce1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1304 microversion: 2.1 time: 0.100133 May 27 03:38:51.078894 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 245/503] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:50 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:51.428240 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:51.429215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:51.435728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:51.436260 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.437140 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:51.437645 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.622357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:51.630394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f4663485-490c-4f5d-b926-c64404beecf6 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1548 microversion: 2.1 time: 0.206360 May 27 03:38:51.630988 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 259/504] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:51 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1548 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:51.646661 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:51.656924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:51.656924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:51.656924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.656924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:51.657411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.826283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:51.843221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d5fc79bd-a81c-411d-8199-3d66cb1844ce tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1548 microversion: 2.1 time: 0.199577 May 27 03:38:51.844752 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 246/505] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:51 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:51.861496 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:51.871098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:51.871098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Searching by: {'deleted': False, 'project_id': '99d82d4c868f404e9bc7e932aadf7670'} {{(pid=124770) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 03:38:51.877982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:51.879188 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.880074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:51.880583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:51.975313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.multi_cell_list [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 03:38:52.079349 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dc7a2d5d-67e0-4ad0-972a-16936f417405 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223000 May 27 03:38:52.083021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 260/506] 10.222.0.24 () {58 vars in 1124 bytes} [Fri May 27 03:38:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:52.090590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:52.091302 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:52.092459 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:52.093150 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:52.099631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:52.100630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:52.100831 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:52.101469 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:52.101905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:52.102017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:52.102719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:52.103192 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:52.402225 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:52.411134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1105e94e-28e4-4936-9583-5096443cfeee tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.323697 May 27 03:38:52.420714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 247/507] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:52 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:52.422902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:52.439137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c192afa0-37ee-43dd-b87a-61ed05b99afb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1548 microversion: 2.1 time: 0.344158 May 27 03:38:52.439137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 261/508] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:52 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1548 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:53.150556 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-60452166-297a-4925-9672-dcddd669ca36 req-ee1ef45b-35d5-4eb4-b262-bdb291589759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526d125-8b79-4f3f-8c07-c9b77ecbc2f5", "tag": "d213f02d-0498-429f-ac43-252d863eb6ad"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:53.165428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-60452166-297a-4925-9672-dcddd669ca36 req-ee1ef45b-35d5-4eb4-b262-bdb291589759 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:53.165865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-60452166-297a-4925-9672-dcddd669ca36 req-ee1ef45b-35d5-4eb4-b262-bdb291589759 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:53.183266 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-60452166-297a-4925-9672-dcddd669ca36 req-ee1ef45b-35d5-4eb4-b262-bdb291589759 service nova] Creating event network-changed:d213f02d-0498-429f-ac43-252d863eb6ad for instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 on hv-cinder-82880 May 27 03:38:53.188778 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-60452166-297a-4925-9672-dcddd669ca36 req-ee1ef45b-35d5-4eb4-b262-bdb291589759 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042046 May 27 03:38:53.189816 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 248/509] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:53.433024 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:53.434963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:53.443731 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:53.444662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:53.445575 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:53.446013 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:53.706520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:53.714192 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-39cd921c-78c2-457b-aac3-03388c51bfae tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.288724 May 27 03:38:53.714729 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 262/510] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:53 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:54.024469 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-856603247", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24e2e56a-4202-49e3-9751-4bcdb4e8a6ed"}], "security_groups": [{"name": "tempest-securitygroup--1988170276"}], "key_name": "tempest-keypair-816668274", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:54.345421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] validate_networks() for [('24e2e56a-4202-49e3-9751-4bcdb4e8a6ed', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:38:54.544731 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14491733-d2c2-4585-a1c9-3d5fd981cfb9"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:54.545894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:54.553961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:54.554436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:54.561144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:54.561673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:54.835112 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:38:54.835536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:38:54.836056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:38:54.836593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:38:54.837008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:38:54.845898 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:54.846598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:54.847974 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:54.848577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:54.865022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:38:54.869008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:38:54.879907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:38:54.882257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:38:55.021297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a13949b2-5e0c-4395-beb4-36a75c8b16f1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.002140 May 27 03:38:55.021861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 249/511] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:38:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:38:55.026375 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:55.027132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:55.033700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:55.034148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:55.034950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:55.035426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:55.173586 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:55.181624 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-216fe611-8cb1-42dd-8a53-6c3a24371fea tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.158752 May 27 03:38:55.182693 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 250/512] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:55 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:55.195727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7a33a64c-dce2-4ac9-862e-282a3409b346 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:55.196711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7a33a64c-dce2-4ac9-862e-282a3409b346 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:55.256593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7a33a64c-dce2-4ac9-862e-282a3409b346 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:55.263217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7a33a64c-dce2-4ac9-862e-282a3409b346 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1240 microversion: 2.1 time: 0.079255 May 27 03:38:55.266132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 251/513] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:55 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:56.199347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:56.199983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:56.206907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:56.207358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:56.208107 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:56.208540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:56.345323 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:56.353681 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8ab25bdb-5d06-4587-9baf-ba220bcee13c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.158119 May 27 03:38:56.354817 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 252/514] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:56 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:56.361369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:56.362393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:56.369053 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:56.369509 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:56.370282 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:56.370721 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:56.435094 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:56.441452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c0d7d837-7a02-4b27-a5b7-401567bae593 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1244 microversion: 2.1 time: 0.084743 May 27 03:38:56.442041 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 253/515] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:56 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:56.533266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a5366464-a49e-43c0-a3cb-68cc53ab4eae tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.991993 May 27 03:38:56.533894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 263/516] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:38:54 2022] POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments => generated 194 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:57.370227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:57.371454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:57.377916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:57.378957 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:57.379726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:57.380182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:57.459308 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:57.460242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:57.469447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:57.470062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:57.471309 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:57.472394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:57.584626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:57.595608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:57.605545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-09d6a29d-ba07-4eb5-9ab2-9254729de590 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1300 microversion: 2.1 time: 0.141053 May 27 03:38:57.605545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 264/517] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:57 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:38:57.606218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8c902f50-6f3d-4f65-b1c3-d9abe30a49e3 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.237824 May 27 03:38:57.606218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 254/518] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:57 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:58.613238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:58.613852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:58.620844 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:58.621294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:58.621589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:58.622063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:58.622271 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:58.622677 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:58.628923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:58.629448 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:58.630403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:58.630876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:58.892979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:58.900958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9040a87b-cd45-4ade-a7a6-1289106fbf86 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.291366 May 27 03:38:58.911474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 265/519] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:58 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:58.945208 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:38:58.958269 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e0e901ef-8636-49e3-8dff-61ea058673bf tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.340625 May 27 03:38:58.968254 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 255/520] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:58 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:38:59.676727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-16c7b593-2f18-4f9d-8cfa-32e4412fce79 req-31c523a7-a371-48ce-a384-adff513da022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354bc006-0821-4eda-8ff5-304b82dad03b", "tag": "8ab3065d-e51c-44d4-a56d-c5b055761796"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:38:59.686446 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-16c7b593-2f18-4f9d-8cfa-32e4412fce79 req-31c523a7-a371-48ce-a384-adff513da022 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:59.686929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-16c7b593-2f18-4f9d-8cfa-32e4412fce79 req-31c523a7-a371-48ce-a384-adff513da022 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:59.697940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-16c7b593-2f18-4f9d-8cfa-32e4412fce79 req-31c523a7-a371-48ce-a384-adff513da022 service nova] Creating event network-changed:8ab3065d-e51c-44d4-a56d-c5b055761796 for instance 354bc006-0821-4eda-8ff5-304b82dad03b on hv-cinder-82880 May 27 03:38:59.702566 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-16c7b593-2f18-4f9d-8cfa-32e4412fce79 req-31c523a7-a371-48ce-a384-adff513da022 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030087 May 27 03:38:59.703334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 266/521] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:38:59.919587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:59.920121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:59.926514 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:59.939246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:59.940074 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:59.940516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:59.976196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:38:59.977008 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:38:59.983378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:59.983919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:38:59.984760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:38:59.985205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:00.184930 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:00.193227 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bee44b3b-f45e-43b1-b500-02d88a0fc8db tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.278146 May 27 03:39:00.194214 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 256/522] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:59 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:00.197019 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:00.205523 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9b4b9647-9cad-4f5c-9806-dd8bb89d3c23 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.233281 May 27 03:39:00.206096 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 267/523] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:38:59 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:01.066715 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-577775c9-e23d-45cd-9ff2-42834d4cbde1 req-cca3a218-1940-4ff2-ba7e-71cfee013375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8526d125-8b79-4f3f-8c07-c9b77ecbc2f5", "name": "network-vif-plugged", "status": "completed", "tag": "d213f02d-0498-429f-ac43-252d863eb6ad"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:01.086264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-577775c9-e23d-45cd-9ff2-42834d4cbde1 req-cca3a218-1940-4ff2-ba7e-71cfee013375 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:01.086720 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-577775c9-e23d-45cd-9ff2-42834d4cbde1 req-cca3a218-1940-4ff2-ba7e-71cfee013375 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:01.102285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-577775c9-e23d-45cd-9ff2-42834d4cbde1 req-cca3a218-1940-4ff2-ba7e-71cfee013375 service nova] Creating event network-vif-plugged:d213f02d-0498-429f-ac43-252d863eb6ad for instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 on hv-cinder-82880 May 27 03:39:01.107587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-577775c9-e23d-45cd-9ff2-42834d4cbde1 req-cca3a218-1940-4ff2-ba7e-71cfee013375 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044479 May 27 03:39:01.108199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 257/524] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:01.211198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:01.211746 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:01.214160 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:01.219278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:01.219761 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:01.220529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:01.220965 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:01.231983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:01.232683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:01.239666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:01.240116 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:01.240880 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:01.241315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:01.419264 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:01.427201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-75a91e8e-a18a-4372-9d77-00f2481da2d5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.219865 May 27 03:39:01.427776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 268/525] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:01 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:01.441777 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:01.449193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eb2fa97e-6e57-4e2b-9aa6-b7f2dfb9ce26 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.221341 May 27 03:39:01.449764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 258/526] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:01 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:02.457205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:02.457826 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:02.459713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:02.461772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:02.466215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:02.466669 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:02.466827 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:02.467474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:02.467588 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:02.467905 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:02.474513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:02.475005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:02.475772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:02.476207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:02.667296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:02.670003 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:02.675744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fb68ac7a-41b4-4656-b746-2a6fda75043c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.223465 May 27 03:39:02.676321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 269/527] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:02 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:02.677616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dcefcff4-661d-4a90-90dc-b947716ae8c8 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.214572 May 27 03:39:02.683645 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 259/528] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:02 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:39:03.692631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:03.693359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:03.694556 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:03.695214 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:03.700322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:03.700777 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:03.701550 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:03.701651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:03.701987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:03.702085 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:03.702826 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:03.703291 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:03.899950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:03.903302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:03.908843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4caccfb8-d6f1-4d7d-bf50-a50f657bcf5f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1369 microversion: 2.1 time: 0.217984 May 27 03:39:03.910321 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 260/529] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:03 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:39:03.913056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-72d939d4-becd-434c-8182-90dcab6434c2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.224253 May 27 03:39:03.913629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 270/530] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:03 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:04.925996 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:04.927403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:04.929999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:04.930620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:04.936094 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:04.937414 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:04.937873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:04.938503 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:04.938634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:04.939135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:04.939454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:04.940439 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:04.941174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:05.164660 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:05.169478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:05.175996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4bd011e6-e151-4c0b-b1af-75b3509a371a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.250283 May 27 03:39:05.176687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 271/531] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:04 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:05.178303 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ae6983e2-079c-42d0-8edd-64f9dcfe8f67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1564 microversion: 2.1 time: 0.256239 May 27 03:39:05.179615 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 261/532] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:04 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1564 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:05.196631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:05.197495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:05.204021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:05.204656 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:05.205705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:05.206139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:05.291871 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fc6c78f1-b5da-4ab4-b81d-e9065f16c607 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099931 May 27 03:39:05.292474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 272/533] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:39:05 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:06.196560 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:06.197180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:06.199144 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=22 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:06.205863 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:06.206314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:06.207141 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:06.207574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:06.273359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:06.273991 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:06.280526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:06.280981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:06.281761 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:06.282234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:06.301616 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:06.724011 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:06.728045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:06.733307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1db4c5c2-364e-4736-9bbc-65afed967296 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1594 microversion: 2.1 time: 0.464283 May 27 03:39:06.734547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 273/534] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:06 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1594 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:39:06.748335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6a2bbaf3-6c31-4f7d-99cf-707229e79b38 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.559095 May 27 03:39:06.754381 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 262/535] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:06 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:06.919301 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1e2abd97-1ff8-4f45-9bb1-967f7e66b7e4 req-a95c8e49-ee8e-45d3-802e-9a81b54d5d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526d125-8b79-4f3f-8c07-c9b77ecbc2f5", "tag": "d213f02d-0498-429f-ac43-252d863eb6ad"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:06.926548 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e2abd97-1ff8-4f45-9bb1-967f7e66b7e4 req-a95c8e49-ee8e-45d3-802e-9a81b54d5d50 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:06.927039 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e2abd97-1ff8-4f45-9bb1-967f7e66b7e4 req-a95c8e49-ee8e-45d3-802e-9a81b54d5d50 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:06.938985 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1e2abd97-1ff8-4f45-9bb1-967f7e66b7e4 req-a95c8e49-ee8e-45d3-802e-9a81b54d5d50 service nova] Creating event network-changed:d213f02d-0498-429f-ac43-252d863eb6ad for instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 on hv-cinder-82880 May 27 03:39:06.945416 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1e2abd97-1ff8-4f45-9bb1-967f7e66b7e4 req-a95c8e49-ee8e-45d3-802e-9a81b54d5d50 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034838 May 27 03:39:06.946485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 274/536] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:07.267041 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-7200c58f-8320-481f-8145-0acb0d0134aa req-aae36434-12ce-4568-9cea-ab43ca834fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354bc006-0821-4eda-8ff5-304b82dad03b", "name": "network-vif-plugged", "status": "completed", "tag": "8ab3065d-e51c-44d4-a56d-c5b055761796"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:07.278357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7200c58f-8320-481f-8145-0acb0d0134aa req-aae36434-12ce-4568-9cea-ab43ca834fd4 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:07.278913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7200c58f-8320-481f-8145-0acb0d0134aa req-aae36434-12ce-4568-9cea-ab43ca834fd4 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:07.295135 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-7200c58f-8320-481f-8145-0acb0d0134aa req-aae36434-12ce-4568-9cea-ab43ca834fd4 service nova] Creating event network-vif-plugged:8ab3065d-e51c-44d4-a56d-c5b055761796 for instance 354bc006-0821-4eda-8ff5-304b82dad03b on hv-cinder-82880 May 27 03:39:07.300872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-7200c58f-8320-481f-8145-0acb0d0134aa req-aae36434-12ce-4568-9cea-ab43ca834fd4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038596 May 27 03:39:07.302066 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 263/537] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:07.768581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:07.769390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:07.776994 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:07.777560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:07.778606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:07.780750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:08.027808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:08.027808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b4e81c6e-948b-4349-ba57-89d5fc364ced tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.252026 May 27 03:39:08.027808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 275/538] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:07 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:09.034500 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:09.035240 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:09.041464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:09.041918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:09.042674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:09.043217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:09.061277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:09.244165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:09.257997 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d4986ed2-0259-4868-b735-00a57d609936 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1366 microversion: 2.1 time: 0.228224 May 27 03:39:09.258697 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 264/539] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:09 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:09.722893 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-1e086ad7-51e1-4494-87a5-25ddd1253984 req-8d05c4ee-312a-4ff9-b26c-df5876e73ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:09.730184 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e086ad7-51e1-4494-87a5-25ddd1253984 req-8d05c4ee-312a-4ff9-b26c-df5876e73ad9 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:09.730630 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-1e086ad7-51e1-4494-87a5-25ddd1253984 req-8d05c4ee-312a-4ff9-b26c-df5876e73ad9 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:09.742046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-1e086ad7-51e1-4494-87a5-25ddd1253984 req-8d05c4ee-312a-4ff9-b26c-df5876e73ad9 service nova] Creating event network-changed:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:39:09.747248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-1e086ad7-51e1-4494-87a5-25ddd1253984 req-8d05c4ee-312a-4ff9-b26c-df5876e73ad9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 May 27 03:39:09.747845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 276/540] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:10.275123 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:10.275860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:10.282522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:10.283191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:10.283765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:10.284375 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:10.537870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:10.545634 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-64bfdea8-cbf1-4135-b5e4-14634afdd356 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1556 microversion: 2.1 time: 0.274542 May 27 03:39:10.546430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 265/541] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:10 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:10.563431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:10.564774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:10.572125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:10.572574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:10.573345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:10.573804 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:10.666506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cca9d8bd-5aed-440a-9e42-5f59ebbafccd tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107480 May 27 03:39:10.667252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 277/542] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:39:10 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:12.065152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-09e9e0bd-3eeb-4618-9c25-0cb0a2643e7c req-d8254b48-569f-485f-9f9e-5749582952a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354bc006-0821-4eda-8ff5-304b82dad03b", "tag": "8ab3065d-e51c-44d4-a56d-c5b055761796"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:12.078761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-09e9e0bd-3eeb-4618-9c25-0cb0a2643e7c req-d8254b48-569f-485f-9f9e-5749582952a7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:12.079557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-09e9e0bd-3eeb-4618-9c25-0cb0a2643e7c req-d8254b48-569f-485f-9f9e-5749582952a7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:12.096974 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-09e9e0bd-3eeb-4618-9c25-0cb0a2643e7c req-d8254b48-569f-485f-9f9e-5749582952a7 service nova] Creating event network-changed:8ab3065d-e51c-44d4-a56d-c5b055761796 for instance 354bc006-0821-4eda-8ff5-304b82dad03b on hv-cinder-82880 May 27 03:39:12.102344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-09e9e0bd-3eeb-4618-9c25-0cb0a2643e7c req-d8254b48-569f-485f-9f9e-5749582952a7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042366 May 27 03:39:12.103075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 266/543] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:12.613651 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-89044771"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:12.615063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:12.622227 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:12.623052 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:12.624180 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:12.624959 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:12.860162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.network.security_group_api [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Adding security group bfba84b5-b809-480d-a2aa-3a4075f5993f to port f5a040c0-7ee8-466d-bbe9-24fdc9c314fb May 27 03:39:13.485875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fdd7ff9f-6bda-4d35-98d6-e661e91916e5 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/action" status: 202 len: 0 microversion: 2.1 time: 0.878229 May 27 03:39:13.486857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 278/544] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:39:12 2022] POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:39:13.496857 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:13.497570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:13.515174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:13.515174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:13.515174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:13.515174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:13.515827 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:13.517917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-0fd2ece5-0173-482f-a705-1019036f2c45 req-5dfb5efa-a99b-4b52-9610-92d81492ea89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:13.549439 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0fd2ece5-0173-482f-a705-1019036f2c45 req-5dfb5efa-a99b-4b52-9610-92d81492ea89 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:13.549439 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-0fd2ece5-0173-482f-a705-1019036f2c45 req-5dfb5efa-a99b-4b52-9610-92d81492ea89 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:13.563104 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-0fd2ece5-0173-482f-a705-1019036f2c45 req-5dfb5efa-a99b-4b52-9610-92d81492ea89 service nova] Creating event network-changed:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:39:13.568945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-0fd2ece5-0173-482f-a705-1019036f2c45 req-5dfb5efa-a99b-4b52-9610-92d81492ea89 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062278 May 27 03:39:13.570106 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 279/545] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:13.782185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:13.791352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-418d6631-f121-4bc7-9b12-0bb7f1939ff9 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1758 microversion: 2.1 time: 0.299146 May 27 03:39:13.791941 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 267/546] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:13 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1758 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:27.911083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=21 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:27.911901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=22 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:27.916048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:27.917533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:27.922574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:27.923067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:27.923838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:27.924265 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:27.952613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f5668d85-3905-4be0-b3f0-6ddfe238396c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments/26bde7da-92cc-4087-926a-1ddbeef8ff2a" status: 200 len: 194 microversion: 2.20 time: 0.043094 May 27 03:39:27.953117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 280/547] 10.222.0.24 () {60 vars in 1453 bytes} [Fri May 27 03:39:27 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments/26bde7da-92cc-4087-926a-1ddbeef8ff2a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:28.016285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:28.016775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:28.018994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:28.019646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=16 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:28.024919 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:28.025364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:28.026113 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:28.026545 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:28.151621 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lazy-loading 'services' on Instance uuid c0670a31-c2d9-43c0-85a8-e15e7513a629 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:39:28.413522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5674a1fc-ade3-4453-9af1-c9b9f0226615 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments/26bde7da-92cc-4087-926a-1ddbeef8ff2a" status: 202 len: 0 microversion: 2.20 time: 0.400987 May 27 03:39:28.414112 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 268/548] 10.222.0.24 () {60 vars in 1456 bytes} [Fri May 27 03:39:28 2022] DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments/26bde7da-92cc-4087-926a-1ddbeef8ff2a => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 03:39:28.423210 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:28.424156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:28.433703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:28.433703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:28.433703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:28.433703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:28.464648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-860cd8f1-8f5a-41c4-956d-cccb9e2552e8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046082 May 27 03:39:28.465131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 281/549] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:28 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:39:29.478079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:29.479167 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:29.485512 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:29.485971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:29.486724 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:29.487190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:29.516113 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1288a5fa-357d-46c9-88d8-abead7afcae0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043396 May 27 03:39:29.516671 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 269/550] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:29 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:30.527897 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:30.528924 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:30.535512 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:30.535964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:30.537328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:30.537763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:30.582970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ae206e6a-14c7-4dfe-9fd6-59a66e5ab422 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058915 May 27 03:39:30.588911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 282/551] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:30 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:31.601311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:31.602237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:31.608811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:31.609206 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:31.609959 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:31.610395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:31.639242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4b2433e5-cc3d-4a40-bfa0-ce0542229375 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041924 May 27 03:39:31.639806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 270/552] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:31 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:32.651485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:32.652501 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:32.659214 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:32.659663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:32.660425 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:32.660861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:32.689250 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5025e586-0dad-484b-9427-10ffd6b5add4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041695 May 27 03:39:32.689733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 283/553] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:32 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:33.701389 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:33.702338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:33.709797 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:33.710190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:33.710980 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:33.711447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:33.740363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0ab8eb97-b3c5-4396-a92a-358ad6e2d6af tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042840 May 27 03:39:33.740924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 271/554] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:33 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:34.752537 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:34.754135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:34.761329 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:34.761792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:34.762631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:34.763098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:34.796875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f132c57f-a4e3-4d97-8e64-c6428eb733eb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049354 May 27 03:39:34.797979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 284/555] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:39:34 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:34.862305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:34.862942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:34.869905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:34.870389 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:34.871181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:34.871620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:34.897540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:39:35.254769 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4b660f50-1875-4b3f-b550-23a6e603cf14 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 204 len: 0 microversion: 2.20 time: 0.396131 May 27 03:39:35.256340 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 272/556] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 27 03:39:34 2022] DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:39:35.265649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:35.267742 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:35.273259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:35.273714 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:35.274499 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:35.274970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:35.430017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:35.438250 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:35.439836 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:35.441033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a6950c36-1e39-49dd-8780-c228a3674b6b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.180050 May 27 03:39:35.441593 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 285/557] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:35 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:36.461581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:36.462272 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:36.468772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:36.469232 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:36.469960 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:36.470386 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:36.603104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:36.611284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:36.612815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:36.613937 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9e45fd62-5e6b-423f-a69d-af5f401b0c34 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.157269 May 27 03:39:36.614526 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 273/558] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:36 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:37.632585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:37.633196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:37.639700 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:37.640152 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:37.640912 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:37.641350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:37.875344 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:37.883437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:37.884970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:37.886152 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ba2b70dd-013e-4aa4-b476-4ea8f7ca598c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1724 microversion: 2.20 time: 0.258059 May 27 03:39:37.886727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 286/559] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:37 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:38.050006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-5fd54d0f-e869-46a3-b222-48ebf206f56d req-516a16e7-ede3-4de6-9029-b29b052c9541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0670a31-c2d9-43c0-85a8-e15e7513a629", "name": "network-vif-deleted", "tag": "e23f1b69-a428-4690-914e-c5c91277d071"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:38.059097 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-5fd54d0f-e869-46a3-b222-48ebf206f56d req-516a16e7-ede3-4de6-9029-b29b052c9541 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:38.059536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-5fd54d0f-e869-46a3-b222-48ebf206f56d req-516a16e7-ede3-4de6-9029-b29b052c9541 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:38.071373 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-5fd54d0f-e869-46a3-b222-48ebf206f56d req-516a16e7-ede3-4de6-9029-b29b052c9541 service nova] Creating event network-vif-deleted:e23f1b69-a428-4690-914e-c5c91277d071 for instance c0670a31-c2d9-43c0-85a8-e15e7513a629 on hv-cinder-82880 May 27 03:39:38.081138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-5fd54d0f-e869-46a3-b222-48ebf206f56d req-516a16e7-ede3-4de6-9029-b29b052c9541 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 May 27 03:39:38.082000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 274/560] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:38.904646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:38.905260 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:38.913223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:38.914053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:38.915117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:38.915562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:38.951073 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:38.951666 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:38.952133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lazy-loading 'fault' on Instance uuid c0670a31-c2d9-43c0-85a8-e15e7513a629 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:39:38.993732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:39.001867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:39.003597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:39.004875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e4a14dc5-3474-4bc6-aed0-0f9d30349309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 200 len: 1371 microversion: 2.20 time: 0.104123 May 27 03:39:39.005521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 287/561] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:38 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:40.024668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:40.025362 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:40.031596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:40.032071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:40.032828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:40.033258 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:40.046902 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] HTTP exception thrown: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Request method failure captured: May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 HTTP/1.1 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb1UkdQRkv3TQQ8OhP0E7bfOnGgxdCSJQ15KnSFlFfIeqY0XxQ3462PdJdTQ8d1PbZVIpvZDx_9oJKwb2E02-c1T9JxhN9AZI32BZCESPDlRfjw9DzwdpRVGJcALRVI2Y_Lki--VgdmohYUZHgNK93fbgOl7mtbCt-pjTgsvI1Yv9U May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:39:40.048488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1377b9e588bd44f3b29b03728c418151", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1377b9e588bd44f3b29b03728c418151"}]}] May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 104a135932a144269f1f2aa7359098ed May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:39:40.050086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': 'c0670a31-c2d9-43c0-85a8-e15e7513a629'} May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:39:40.051033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:39:40.052478 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:39:40.053761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Returning 404 to user: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:39:40.053761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4e8de1a1-bb7b-4681-a83f-53c021f22d58 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 404 len: 111 microversion: 2.20 time: 0.030399 May 27 03:39:40.053761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 275/562] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:40 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:39:40.058827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e5d6532-30b7-40f5-b11e-bfc8a617b26c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '.version_select at 0x7f30466f24c0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:40.154190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e5d6532-30b7-40f5-b11e-bfc8a617b26c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853555635" status: 204 len: 0 microversion: 2.20 time: 0.099147 May 27 03:39:40.154806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 288/563] 10.222.0.24 () {60 vars in 1258 bytes} [Fri May 27 03:39:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853555635 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:39:40.921350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2412aa86-0d73-436a-933b-ef3b8c127e74 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'create', calling method: .version_select at 0x7f3046807820>, body: {"keypair": {"name": "tempest-keypair-2058245803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQRvtkfnlL9IhfRlzHaT487ObD3ua+8bCZXAUpDtr7u4fANKPMmbiphC8DhCh0EeW1nxDllxjVDNKmdP1BEYPIxo5CO9VvqkqHxmeHtZCL0b2jZIn9sYIo67ItGzny5Tg=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:40.935179 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-2412aa86-0d73-436a-933b-ef3b8c127e74 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for project 1377b9e588bd44f3b29b03728c418151. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:39:40.938916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-2412aa86-0d73-436a-933b-ef3b8c127e74 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for user 104a135932a144269f1f2aa7359098ed and project 1377b9e588bd44f3b29b03728c418151. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:39:41.038280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2412aa86-0d73-436a-933b-ef3b8c127e74 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.120872 May 27 03:39:41.038951 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 276/564] 10.222.0.24 () {62 vars in 1199 bytes} [Fri May 27 03:39:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 03:39:43.490552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1100485915", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85c37aa4-afb9-42cc-ab9f-3e1ebf705aa1"}], "security_groups": [{"name": "tempest-securitygroup--1978115629"}], "key_name": "tempest-keypair-2058245803", "user_data": "}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:43.592111 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] validate_networks() for [('85c37aa4-afb9-42cc-ab9f-3e1ebf705aa1', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:39:43.943560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:39:43.943932 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:39:43.944404 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:39:43.944809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:39:43.945214 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:39:43.953922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:43.954363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:43.955217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:43.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:43.972445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for project 1377b9e588bd44f3b29b03728c418151. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:39:43.980400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Getting quotas for user 104a135932a144269f1f2aa7359098ed and project 1377b9e588bd44f3b29b03728c418151. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:39:43.995057 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:39:43.997340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:39:44.131627 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24a79a8d-3059-47be-918f-bd770f4c2500 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.646007 May 27 03:39:44.132268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 289/565] 10.222.0.24 () {62 vars in 1187 bytes} [Fri May 27 03:39:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:39:44.143120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3c02cf95-d3d6-4e8c-bfa1-820db08e8ec4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:44.143740 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3c02cf95-d3d6-4e8c-bfa1-820db08e8ec4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:44.198083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c02cf95-d3d6-4e8c-bfa1-820db08e8ec4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:44.205383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c02cf95-d3d6-4e8c-bfa1-820db08e8ec4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:44.207174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c02cf95-d3d6-4e8c-bfa1-820db08e8ec4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:44.208785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3c02cf95-d3d6-4e8c-bfa1-820db08e8ec4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1282 microversion: 2.20 time: 0.070250 May 27 03:39:44.209333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 277/566] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:44 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:45.228180 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:45.228916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:45.235168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:45.235670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:45.236422 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:45.236852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:45.295313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:45.303264 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:45.304811 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:45.305919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-205933aa-2777-49a0-ac44-98b445acf1c9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1286 microversion: 2.20 time: 0.082787 May 27 03:39:45.306478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 290/567] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:45 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:46.323952 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:46.324558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:46.331487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:46.331874 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:46.332630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:46.333061 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:46.395816 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:46.404290 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:46.405820 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:46.406969 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3a1ed60e-46fd-43f9-b8f3-2b9b84edc277 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1334 microversion: 2.20 time: 0.086973 May 27 03:39:46.411488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 278/568] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:46 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:47.425814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:47.426424 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:47.432509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:47.432958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:47.433714 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:47.434156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:47.665226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:47.674198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:47.676471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:47.677740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ddd29cae-6d18-4678-8336-ab16f42d5c6a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.256039 May 27 03:39:47.678594 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 291/569] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:47 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:48.696400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:48.700372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:48.708706 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:48.709187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:48.710001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:48.710439 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:48.734922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-42cb42d0-2eac-4000-85b7-5b852d51eedb req-03eba008-2d49-4f9a-8ff5-fe0610bd58ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:48.753868 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-42cb42d0-2eac-4000-85b7-5b852d51eedb req-03eba008-2d49-4f9a-8ff5-fe0610bd58ed service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:48.754309 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-42cb42d0-2eac-4000-85b7-5b852d51eedb req-03eba008-2d49-4f9a-8ff5-fe0610bd58ed service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:48.774898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-42cb42d0-2eac-4000-85b7-5b852d51eedb req-03eba008-2d49-4f9a-8ff5-fe0610bd58ed service nova] Creating event network-changed:ee7bf9c2-a2d0-4695-960b-55515919a177 for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 on hv-cinder-82880 May 27 03:39:48.783503 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-42cb42d0-2eac-4000-85b7-5b852d51eedb req-03eba008-2d49-4f9a-8ff5-fe0610bd58ed service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056229 May 27 03:39:48.784936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 292/570] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:48.909393 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:48.918278 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:48.919993 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:48.921085 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ce8a0bef-0979-47b4-8982-f2de8f1d34de tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.228613 May 27 03:39:48.921638 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 279/571] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:48 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:49.940177 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:49.940872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:49.947159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:49.947620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:49.948378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:49.948983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:50.097913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:50.106748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:50.108305 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:50.109435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-12332f51-3ce8-4e42-9072-5a786f1a984d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.174063 May 27 03:39:50.110000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 293/572] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:49 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:51.128296 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:51.128836 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:51.135370 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:51.135828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:51.136583 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:51.137017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:51.264114 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:51.272536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:51.274207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:51.275346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6879bde7-ceaf-4a53-b334-6c7c8d6e12ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.151011 May 27 03:39:51.275918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 280/573] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:51 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:52.292934 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:52.293531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:52.300058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:52.300502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:52.301299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:52.302272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:52.431255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:52.439151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:52.440660 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:52.441867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e86294d2-b75b-4736-8d78-7cc2558b1c2e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.152748 May 27 03:39:52.442426 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 294/574] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:52 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:53.455131 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:53.456657 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:53.460896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:53.461584 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:53.463697 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.464151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.465132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.465577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.475156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.475613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.476437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.476870 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.603670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:53.611605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:53.613175 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:53.614295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2ee17cc0-e660-43de-ad78-63f714fc2205 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.158333 May 27 03:39:53.615010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 295/575] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:53 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:53.680558 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b08005-b4ba-48f1-99a2-68f67a848f22"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:53.681579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:53.687961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.688421 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.689223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.689681 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.751703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b4795b82-6e58-4276-b94c-8048febf62f3 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/action" status: 202 len: 0 microversion: 2.1 time: 0.300548 May 27 03:39:53.752698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 281/576] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:39:53 2022] POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:39:53.769244 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:53.770689 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:53.777083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.777534 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.778300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:53.778736 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:53.929262 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:53.938881 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c11fc350-b92a-4964-9019-4b38005dfcbf tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1750 microversion: 2.1 time: 0.173669 May 27 03:39:53.939510 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 282/577] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:53 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:39:53.964081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:53.988376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:54.619456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c5fc5e8c-eaa9-4ac9-bb18-f5103e3d5c67 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942634 May 27 03:39:54.620543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 296/578] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:39:53 2022] POST /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:39:54.636215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:54.636831 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:54.638770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:54.644850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:54.645863 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:54.646637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:54.647222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:54.781546 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:54.790622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:54.792178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:54.793281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f65a0610-68b4-45b9-8384-bb4aa9dff35d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.161541 May 27 03:39:54.793843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 283/579] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:54 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:54.956972 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:54.957705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:54.964267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:54.964714 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:54.965522 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:54.965953 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:54.969918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:55.107846 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:55.116301 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f4e79d6d-0f23-48ba-8584-2297aa0f726b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.163733 May 27 03:39:55.116868 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 297/580] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:54 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:55.394804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-69295e39-17a3-49ba-a2e5-57bbb38da009 req-9ea23e8a-a360-4b40-b8bc-64b12771d8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "name": "network-vif-plugged", "status": "completed", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:55.403536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-69295e39-17a3-49ba-a2e5-57bbb38da009 req-9ea23e8a-a360-4b40-b8bc-64b12771d8da service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:55.403982 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-69295e39-17a3-49ba-a2e5-57bbb38da009 req-9ea23e8a-a360-4b40-b8bc-64b12771d8da service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:55.415163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-69295e39-17a3-49ba-a2e5-57bbb38da009 req-9ea23e8a-a360-4b40-b8bc-64b12771d8da service nova] Creating event network-vif-plugged:ee7bf9c2-a2d0-4695-960b-55515919a177 for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 on hv-cinder-82880 May 27 03:39:55.419966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-69295e39-17a3-49ba-a2e5-57bbb38da009 req-9ea23e8a-a360-4b40-b8bc-64b12771d8da service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028866 May 27 03:39:55.420547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 284/581] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:55.811790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:55.812407 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:55.819739 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:55.820198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:55.820966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:55.821405 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:55.955410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:55.963616 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:55.965151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:55.966386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b677454f-7872-4ac0-a642-d24a94b92f47 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.159087 May 27 03:39:55.967013 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 298/582] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:55 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:56.135464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:56.136177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:56.143399 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:56.143853 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:56.144646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:56.145745 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:56.149769 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:56.289672 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:56.294456 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f2792810-8b2d-4713-9cc5-7e9d067cc17c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.163559 May 27 03:39:56.295045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 285/583] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:56 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:39:56.679758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:56.680249 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:56.687395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:56.687845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:56.688605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:56.689043 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:56.713015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-43e8f946-f3d0-49f8-85cd-8e729fdc5896 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/ips" status: 200 len: 149 microversion: 2.1 time: 0.037134 May 27 03:39:56.713574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 299/584] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:39:56 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:56.984954 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:56.985597 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:56.992928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:56.994315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:56.994315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:56.994654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:57.130241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:57.138601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:57.140464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:57.141427 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3397f406-9c4b-46f8-81e8-aec6f7555937 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1408 microversion: 2.20 time: 0.160403 May 27 03:39:57.141994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 286/585] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:56 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:57.312262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:57.312895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:57.319942 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:57.320513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:57.321266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:57.321737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:57.468591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:57.475849 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bc76e025-0db6-4d26-aa75-0c841757449c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.167885 May 27 03:39:57.476740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 300/586] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:57 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:58.159334 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:58.159936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:58.162803 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:58.167743 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.168264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.169017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.169450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.299872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:58.308360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:58.310004 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:58.311259 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9b3fe9cb-7080-404e-b897-1a532135e2ac tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1600 microversion: 2.20 time: 0.155782 May 27 03:39:58.311839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 287/587] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:39:58 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:58.334691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:58.335224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:58.341911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.342362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.343150 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.343587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.420853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-66b1666b-61be-404a-a734-e317c746d5aa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090204 May 27 03:39:58.421482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 301/588] 10.222.0.24 () {60 vars in 1315 bytes} [Fri May 27 03:39:58 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:58.493414 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:58.494138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:58.500819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.501386 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.502256 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.503031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.509251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03072049-5999-43e9-8b23-d63dbca65a56"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:58.510429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:58.517148 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:58.518984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.519141 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.520380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.520818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.780758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:58.789357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bf53b020-6523-410d-b672-5d0c315189b7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.300353 May 27 03:39:58.789932 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 288/589] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:58 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:39:58.950772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:39:58.951812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:58.958175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.958623 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.959409 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:58.959847 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:58.984298 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lazy-loading 'flavor' on Instance uuid 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:39:59.379983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7ab02e70-34f0-4cfb-9395-54f31c58894c tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/action" status: 200 len: 32 microversion: 2.1 time: 0.432882 May 27 03:39:59.380672 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 289/590] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:39:58 2022] POST /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:39:59.390370 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:59.391120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:59.398792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:59.399299 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:59.400064 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:59.400495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:59.409510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ba2e7225-0d80-482c-9915-44c8aab5f4e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904825 May 27 03:39:59.415940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 302/591] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:39:58 2022] POST /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:39:59.661948 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:39:59.670124 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2861e0f7-dc9c-48ed-a98b-ace7eddf56e2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.284058 May 27 03:39:59.670958 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 290/592] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:59 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:39:59.807356 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:59.808331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:39:59.819237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:59.819791 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:39:59.820672 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:39:59.821206 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:00.096854 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-e563a15b-ecfa-49df-8a93-92437f1496a5 req-2453f027-147a-4f92-9114-10f182f7ae6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:00.105919 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-e563a15b-ecfa-49df-8a93-92437f1496a5 req-2453f027-147a-4f92-9114-10f182f7ae6e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:00.106364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-e563a15b-ecfa-49df-8a93-92437f1496a5 req-2453f027-147a-4f92-9114-10f182f7ae6e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:00.119629 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-e563a15b-ecfa-49df-8a93-92437f1496a5 req-2453f027-147a-4f92-9114-10f182f7ae6e service nova] Creating event network-changed:ee7bf9c2-a2d0-4695-960b-55515919a177 for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 on hv-cinder-82880 May 27 03:40:00.126280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-e563a15b-ecfa-49df-8a93-92437f1496a5 req-2453f027-147a-4f92-9114-10f182f7ae6e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032422 May 27 03:40:00.127956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 291/593] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:00.269137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:00.279508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9804c99e-af06-41f8-a6fd-da14e925012b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.476182 May 27 03:40:00.291914 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 303/594] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:39:59 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:00.688472 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:00.689175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:00.695812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:00.696262 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:00.697033 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:00.697466 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:00.829714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:00.839547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ead82373-237d-4048-8bfc-675681f4fe08 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.155528 May 27 03:40:00.840330 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 292/595] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:00 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:01.297578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:01.298185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:01.304673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:01.305116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:01.305865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:01.306294 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:01.448454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:01.457957 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-70b594c6-c3fb-4d65-8bc0-44062d8974ab tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.163602 May 27 03:40:01.458542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 304/596] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:01 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:01.857552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:01.858283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:01.865611 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:01.866057 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:01.866851 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:01.867282 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:01.992322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:02.000255 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3adcb5d8-aa98-40d1-b2c8-8177a305de4f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.146702 May 27 03:40:02.000817 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 293/597] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:01 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:02.475581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:02.476189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:02.482612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:02.483368 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:02.484128 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:02.484563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:02.624740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:02.633484 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1be258f2-27c6-4003-96c4-1179d080ebfd tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.162366 May 27 03:40:02.634043 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 305/598] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:02 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:03.017502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:03.018119 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:03.025104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:03.025554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:03.026305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:03.026737 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:03.153198 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:03.161920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a26f1710-15d2-4cbf-a55e-61db86a08b22 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.148269 May 27 03:40:03.162490 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 294/599] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:03 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:03.650895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:03.651616 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:03.658040 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:03.658491 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:03.659283 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:03.659722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:03.813561 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:03.822720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e32bebe0-cf99-44fc-a4ca-0aef4eaf7054 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.175710 May 27 03:40:03.823327 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 306/600] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:03 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:04.179308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:04.179952 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:04.186641 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:04.187120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:04.187865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:04.188291 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:04.312906 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:04.321491 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3cedfb4a-5794-46ba-8ba4-dc1d1685fb9e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.146098 May 27 03:40:04.322061 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 295/601] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:04 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:04.840125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:04.840748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:04.847482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:04.848430 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:04.849198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:04.849639 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:04.990929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:04.999063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-198c8b66-7865-43ef-82cc-3bdec695b2fc tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.162832 May 27 03:40:04.999634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 307/602] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:04 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:05.338909 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:05.339521 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:05.346098 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:05.346547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:05.347338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:05.348360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:05.473517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:05.481531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-537a7142-8421-4f5f-9563-cdeac2f058fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.146586 May 27 03:40:05.482092 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 296/603] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:05 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:06.016255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:06.016764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:06.023427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:06.023905 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:06.024668 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:06.025102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:06.168316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:06.177734 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9b91e26c-a7b2-4da2-91ec-b8603c6a4753 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.164932 May 27 03:40:06.178324 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 308/604] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:06 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:06.498477 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:06.499128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:06.505751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:06.506201 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:06.506985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:06.507425 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:06.640013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:06.647940 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b28b8a3a-ea72-4265-910e-7ee222e56875 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.153318 May 27 03:40:06.648519 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 297/605] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:06 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:07.195454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:07.196115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:07.202596 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:07.203086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:07.203868 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:07.204277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:07.341431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:07.349431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ef7d6c66-011e-4ded-983d-5485c9895376 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.158449 May 27 03:40:07.350018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 309/606] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:07 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:07.665484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:07.666003 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:07.672538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:07.672990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:07.673748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:07.674188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:07.963584 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:07.971599 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d83ea01b-df6b-4f9c-8a4a-c55570c9352e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.310093 May 27 03:40:07.972162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 298/607] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:07 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:07.972386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03072049-5999-43e9-8b23-d63dbca65a56"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:07.973511 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:07.979493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:07.979945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:07.980703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:07.981139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.058127 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Invalid volume: volume 03072049-5999-43e9-8b23-d63dbca65a56 is already attached to instances: 354bc006-0821-4eda-8ff5-304b82dad03b May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: POST /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments HTTP/1.1 May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 74 May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:40:08.059888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {"volumeAttachment": {"volumeId": "03072049-5999-43e9-8b23-d63dbca65a56"}} May 27 03:40:08.061399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Invalid volume: volume 03072049-5999-43e9-8b23-d63dbca65a56 is already attached to instances: 354bc006-0821-4eda-8ff5-304b82dad03b May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'server_id': '354bc006-0821-4eda-8ff5-304b82dad03b', 'body': {'volumeAttachment': {'volumeId': '03072049-5999-43e9-8b23-d63dbca65a56'}}} May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03072049-5999-43e9-8b23-d63dbca65a56 is already attached to instances: 354bc006-0821-4eda-8ff5-304b82dad03b May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:08.062257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03072049-5999-43e9-8b23-d63dbca65a56 is already attached to instances: 354bc006-0821-4eda-8ff5-304b82dad03b May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:08.063591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03072049-5999-43e9-8b23-d63dbca65a56 is already attached to instances: 354bc006-0821-4eda-8ff5-304b82dad03b May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 400 to user: Invalid volume: volume 03072049-5999-43e9-8b23-d63dbca65a56 is already attached to instances: 354bc006-0821-4eda-8ff5-304b82dad03b {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-05febdf7-418a-4212-9ade-bea11b1dd788 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093028 May 27 03:40:08.064958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 310/608] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:40:07 2022] POST /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:40:08.122482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:08.123028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:08.128983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.129428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.132746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.132746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.211074 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'services' on Instance uuid 354bc006-0821-4eda-8ff5-304b82dad03b {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:40:08.339824 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:08.365957 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:08.366568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:08.373086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.373536 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.374304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.374744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.461995 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0dc8e4a6-3c2a-480f-8f8c-205a90add481 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments/03072049-5999-43e9-8b23-d63dbca65a56" status: 202 len: 0 microversion: 2.1 time: 0.343173 May 27 03:40:08.462594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 299/609] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:40:08 2022] DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments/03072049-5999-43e9-8b23-d63dbca65a56 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:40:08.471252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:08.472593 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:08.480335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.480785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.481765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.482196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.513833 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bd685b59-98f2-4589-85fd-c1803fd01ff2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046795 May 27 03:40:08.514404 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 300/610] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:40:08 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:08.569118 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:08.577190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ade3ce76-89e9-42c4-b864-fd084593b206 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.215616 May 27 03:40:08.577991 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 311/611] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:08 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:08.989038 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:08.989651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:08.996395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.996840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:08.997597 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:08.998030 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:09.125840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:09.133977 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-301b6e1b-ab76-470e-977d-a65c5082c296 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.149211 May 27 03:40:09.134581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 301/612] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:08 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:09.526135 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:09.527161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:09.533610 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:09.534045 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:09.534805 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:09.535267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:09.563708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5f14be18-7053-41b7-9f23-7883e9673c30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 May 27 03:40:09.564269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 312/613] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:40:09 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:09.593840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:09.594634 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:09.600716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:09.601190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:09.601938 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:09.602390 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:09.750749 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:09.759376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ff92300d-98ce-44ce-b352-3c2d94e80551 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.169601 May 27 03:40:09.759950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 302/614] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:09 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:10.151886 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:10.152495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:10.158511 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.158998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.159761 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.160197 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.164940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:10.285722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:10.294142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a208f2d8-1e4f-499c-9426-61c880f151b5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.146719 May 27 03:40:10.294712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 313/615] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:10 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:10.575774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:10.576746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:10.584317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.584761 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.585542 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.585973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.615734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c87c31ec-7916-4ddc-9b3c-d2cdd050ac60 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043832 May 27 03:40:10.616303 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 303/616] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:40:10 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:40:10.673010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:10.673505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:10.680157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.680603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.681351 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.681789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.709246 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:40:10.776553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:10.781135 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:10.783501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.783950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.784746 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:10.785178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:10.930291 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:10.938351 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-08d48404-c230-4476-b2d3-0376915f1d38 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1755 microversion: 2.1 time: 0.165694 May 27 03:40:10.938954 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 304/617] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:10 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:11.112650 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8d2c2a28-7ac7-4106-907b-38820176b195 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 204 len: 0 microversion: 2.1 time: 0.443393 May 27 03:40:11.113239 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 314/618] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:40:10 2022] DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:40:11.121525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:11.122141 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:11.128213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:11.128668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:11.129424 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:11.129871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:11.258539 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:11.266156 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c79c9b07-b34a-408a-8f02-ab23411ee26b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1680 microversion: 2.1 time: 0.148575 May 27 03:40:11.266738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 305/619] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:11 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:11.311746 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:11.312458 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:11.319580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:11.320030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:11.320817 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:11.321256 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:11.452479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:11.461185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ff30f30a-e97d-465c-8bb2-161f15792895 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.153703 May 27 03:40:11.461753 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 315/620] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:11 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:11.956760 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:11.957365 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:11.963865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:11.964309 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:11.965057 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:11.965482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:12.104402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:12.112560 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-17b398c8-676d-4c00-9cbb-5670fd596d39 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1758 microversion: 2.1 time: 0.160371 May 27 03:40:12.113162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 306/621] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:11 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:12.283815 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:12.284362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:12.291363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:12.291813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:12.292576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:12.293022 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:12.418142 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:12.425770 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4845f3d2-e636-411a-8e55-30499992d8af tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1680 microversion: 2.1 time: 0.145856 May 27 03:40:12.426338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 316/622] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:12 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:12.477804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:12.478407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:12.484433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:12.484876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:12.485619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:12.486076 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:12.616075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:12.623934 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a23f73f6-afc1-4150-b2fe-37e85f2b9e66 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.150446 May 27 03:40:12.624502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 307/623] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:12 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:13.443724 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:13.444333 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:13.450829 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:13.451307 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:13.452069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:13.452510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:13.576445 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:13.584730 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3ad186c4-0a92-4155-ba1f-2dda6e399718 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1680 microversion: 2.1 time: 0.145007 May 27 03:40:13.585299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 317/624] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:13 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:13.640897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:13.641554 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:13.648044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:13.648492 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:13.649253 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:13.649689 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:13.777023 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:13.784869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a97377c7-bdea-462a-b9ca-9abf0b3f9370 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.147860 May 27 03:40:13.785448 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 308/625] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:13 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:14.601498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:14.602168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:14.608934 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:14.615370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:14.615370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:14.615370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:14.742909 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:14.750418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dc414b53-ff10-40cf-8c0b-ba5c11525bc6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1680 microversion: 2.1 time: 0.152816 May 27 03:40:14.751243 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 318/626] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:14 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:14.803263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:14.804937 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:14.811506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:14.811963 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:14.812726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:14.813166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:14.957867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:14.967648 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-01935ffd-ef4c-4b57-bc2c-343c356ace84 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.167881 May 27 03:40:14.967648 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 309/627] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:14 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:15.473282 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-d1320888-26a6-4ef0-a7e3-8b714628bd7c req-3ec8bb14-3e87-45dd-84d3-417924066cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354bc006-0821-4eda-8ff5-304b82dad03b", "name": "network-vif-deleted", "tag": "8ab3065d-e51c-44d4-a56d-c5b055761796"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:15.481858 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d1320888-26a6-4ef0-a7e3-8b714628bd7c req-3ec8bb14-3e87-45dd-84d3-417924066cda service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.482366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d1320888-26a6-4ef0-a7e3-8b714628bd7c req-3ec8bb14-3e87-45dd-84d3-417924066cda service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:15.494151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-d1320888-26a6-4ef0-a7e3-8b714628bd7c req-3ec8bb14-3e87-45dd-84d3-417924066cda service nova] Creating event network-vif-deleted:8ab3065d-e51c-44d4-a56d-c5b055761796 for instance 354bc006-0821-4eda-8ff5-304b82dad03b on hv-cinder-82880 May 27 03:40:15.498908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-d1320888-26a6-4ef0-a7e3-8b714628bd7c req-3ec8bb14-3e87-45dd-84d3-417924066cda service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029390 May 27 03:40:15.499490 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 319/628] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:15.678281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:15.678814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:15.685118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.685569 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:15.686335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.686786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:15.714646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lazy-loading 'flavor' on Instance uuid d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:40:15.769106 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:15.769755 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:15.776020 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.776471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:15.777238 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.777673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:15.863419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:15.873125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-406d034f-3ac7-4ee9-870e-275836d6b548 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1612 microversion: 2.1 time: 0.108662 May 27 03:40:15.874581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 320/629] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:15 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:15.984556 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:15.985171 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:15.991272 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.991726 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:15.992788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:15.993397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:16.102222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b5e2b259-7c21-4836-a38f-157895cb341a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "POST /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.427700 May 27 03:40:16.106185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 310/630] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:40:15 2022] POST /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:40:16.117542 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:16.118561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:16.125319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:16.126017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:16.126788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:16.127278 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:16.151262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:16.162305 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1ccbc7db-a5a9-4664-bc57-11325258ad63 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1735 microversion: 2.1 time: 0.180803 May 27 03:40:16.163056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 321/631] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:15 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:16.271582 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:16.279818 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8a7b97e0-9926-4f85-9e93-6de076bd5cb3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.169263 May 27 03:40:16.280728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 311/632] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:16 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:16.892748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:16.893288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:16.900114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:16.901799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:16.901799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:16.901799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:16.937599 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:16.938052 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:16.938562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'fault' on Instance uuid 354bc006-0821-4eda-8ff5-304b82dad03b {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:40:16.978383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:16.985808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-66636775-fef8-403e-8f63-2ebf35074aeb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 200 len: 1330 microversion: 2.1 time: 0.097024 May 27 03:40:16.986383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 322/633] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:16 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:17.180347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:17.180860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:17.187704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.188160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.188917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.189372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.297498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:17.298223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:17.305034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.305563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.306521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.307002 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.335867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:17.344300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eb49cb43-84cf-4648-85db-eb1ef7afe25e tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1715 microversion: 2.1 time: 0.168374 May 27 03:40:17.344915 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 312/634] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:17 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:17.438280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:17.446364 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5bd16310-d37c-4deb-b593-3e798288a4d4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.152796 May 27 03:40:17.446936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 323/635] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:17 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:17.453311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:17.453809 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:17.460819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.461270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.462032 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.462470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.543104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] HTTP exception thrown: Cannot 'detach_volume' instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 while it is in vm_state rescued May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Request method failure captured: May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments/d4b08005-b4ba-48f1-99a2-68f67a848f22 HTTP/1.1 May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEdJle72uA52wRzl38Wo43jLfBUD8_6-W2I-TixspRM8trW4-_2haG8mfc5F9L3Xi5Bqj3rHIho7SA8IGXv5IHFoJA36ducSbafluUVIdz287TsaM13us68tDUJkPJf9fZzmKloTmtdMm-Skgg0llpRkAvVz2pqCiat4SA7MX--FAis May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:40:17.545079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_03b1335715234895a0c1a555b22ee8d3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/03b1335715234895a0c1a555b22ee8d3"}]}] May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: b2671aaae84644acb89c3c3595bb5673 May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:40:17.546616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Cannot 'detach_volume' instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 while it is in vm_state rescued May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'server_id': '8526d125-8b79-4f3f-8c07-c9b77ecbc2f5', 'id': 'd4b08005-b4ba-48f1-99a2-68f67a848f22'} May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:40:17.547479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 while it is in vm_state rescued May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 while it is in vm_state rescued May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:17.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Returning 409 to user: Cannot 'detach_volume' instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 while it is in vm_state rescued {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:40:17.550350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-09507a31-bef2-4197-a1ff-410918d1adfb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments/d4b08005-b4ba-48f1-99a2-68f67a848f22" status: 409 len: 152 microversion: 2.1 time: 0.097149 May 27 03:40:17.550350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 313/636] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:40:17 2022] DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments/d4b08005-b4ba-48f1-99a2-68f67a848f22 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 03:40:17.556133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:17.556756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:17.563058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.563505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.564273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.564702 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.836146 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0dc66b08-4bc0-4e37-8f13-602ad84a489a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "POST /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/action" status: 202 len: 0 microversion: 2.1 time: 0.284083 May 27 03:40:17.836918 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 324/637] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:40:17 2022] POST /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:40:17.845171 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:17.848397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:17.853275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.853728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.854496 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:17.854963 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:17.873181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:17.993312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:18.002017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a37f5479-179c-48c1-aa01-4edf5497b032 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1723 microversion: 2.1 time: 0.160439 May 27 03:40:18.002806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 314/638] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:17 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:18.012235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:18.012235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:18.012235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:18.012235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:18.012943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:18.012943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:18.027301 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b HTTP/1.1 May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:40:18.028940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:40:18.030269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '354bc006-0821-4eda-8ff5-304b82dad03b'} May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:40:18.031162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:40:18.032806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:40:18.034232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:40:18.034232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d61b57c1-991b-46ed-921a-720439ecccb5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 404 len: 111 microversion: 2.1 time: 0.030608 May 27 03:40:18.034232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 325/639] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:17 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:40:18.039748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ba03f836-0f2e-49e5-bd95-192a5bb983b8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '.version_select at 0x7f30466beaf0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:18.114174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ba03f836-0f2e-49e5-bd95-192a5bb983b8 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816668274" status: 202 len: 0 microversion: 2.1 time: 0.078554 May 27 03:40:18.114708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 315/640] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 27 03:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816668274 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:40:18.464772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:18.465632 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:18.474076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:18.474535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:18.475344 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:18.475779 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:18.670069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:18.678355 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2a6a1c00-687e-46a3-9eca-e65008a42a20 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.217425 May 27 03:40:18.679459 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 326/641] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:18 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:18.979515 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1e687e16-1683-4784-b303-61117b2523a0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: .version_select at 0x7f30466d7820>, body: {"keypair": {"name": "tempest-keypair-910603045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLdZLreusti1Hggg1taFqBihmm0q2iY/OUI4o7sdp8oUVReJ1rDDqMLHaKy7v1vu11jskwh2ZbX9ClNStTd5PAju1AiaLgk1aeV0LiPpaCWpupk4P8nlUaUYnu6Xf3Tqw=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:18.993825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-1e687e16-1683-4784-b303-61117b2523a0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:40:18.997710 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-1e687e16-1683-4784-b303-61117b2523a0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:40:19.019769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:19.020885 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:19.027455 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:19.027907 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:19.028666 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:19.029102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:19.072486 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1e687e16-1683-4784-b303-61117b2523a0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098481 May 27 03:40:19.073308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 316/642] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:40:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:19.160021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:19.168127 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-26e574d4-f9d1-4041-b9d5-078ed132f660 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1723 microversion: 2.1 time: 0.152165 May 27 03:40:19.168691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 327/643] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:19 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:19.696880 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:19.715598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:19.715598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:19.715598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:19.715598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:19.716016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:19.834070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:19.841873 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d6fdd658-2204-4c3d-b874-c22cdd3c2b62 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.149718 May 27 03:40:19.842457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 317/644] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:19 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:20.185503 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:20.186028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:20.192605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:20.193056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:20.193824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:20.194262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:20.198330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:20.323568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:20.331683 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e1cf294d-651d-4da0-b239-6916210da9ce tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1723 microversion: 2.1 time: 0.149974 May 27 03:40:20.332263 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 328/645] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:20 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:20.859487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:20.860134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:20.866679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:20.867158 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:20.867918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:20.868360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:20.997767 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:21.006426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c87d8264-1c5a-4053-86a5-c5a55b54cbe1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.150743 May 27 03:40:21.007030 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 318/646] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:20 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:21.349794 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:21.350405 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:21.357395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:21.357848 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:21.358615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:21.359088 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:21.489259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:21.497259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e9d6edd0-ba7a-4af0-8c92-b3328c767bbe tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1723 microversion: 2.1 time: 0.151689 May 27 03:40:21.497764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 329/647] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:21 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:21.938243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-375503746", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24e2e56a-4202-49e3-9751-4bcdb4e8a6ed"}], "security_groups": [{"name": "tempest-securitygroup--1533284675"}], "key_name": "tempest-keypair-910603045", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:22.023504 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:22.024216 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:22.031149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.032889 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.033857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.034371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.043231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] validate_networks() for [('24e2e56a-4202-49e3-9751-4bcdb4e8a6ed', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:40:22.244187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:22.252350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4349b4c0-7a67-4d66-ab7a-e9072067a438 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.233346 May 27 03:40:22.253177 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 330/648] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:22 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:22.515219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:22.515890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:22.516523 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:40:22.516947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:40:22.517421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:40:22.517824 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:40:22.518231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:40:22.522946 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.523590 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.524371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.524810 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.528134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.528582 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.529375 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.529808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.546918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:40:22.550822 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Getting quotas for user dac1130950b8457ea3a9349346437357 and project 8ae1382d8f774b5db702d78e3bed622a. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:40:22.561808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:40:22.564120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:40:22.657288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:22.666088 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2494deea-739b-4947-81c7-2b478fcd6f7f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1729 microversion: 2.1 time: 0.155076 May 27 03:40:22.666658 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 331/649] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:22 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:22.682746 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:22.683211 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:22.689146 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.689602 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.690366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:22.690806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:22.714570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f3b7c65-c7f2-4a6c-952e-453099d99e8f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.780480 May 27 03:40:22.720467 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 319/650] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:40:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:40:22.728400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f173b6f7-40fe-4d3c-97c7-925edbed9f54 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:22.729219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f173b6f7-40fe-4d3c-97c7-925edbed9f54 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:22.791442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f173b6f7-40fe-4d3c-97c7-925edbed9f54 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:22.798966 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b3f388ca-8966-41c9-920b-ca1f70e63d3b tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119385 May 27 03:40:22.799110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f173b6f7-40fe-4d3c-97c7-925edbed9f54 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1240 microversion: 2.1 time: 0.074312 May 27 03:40:22.799584 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 332/651] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:40:22 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:22.799702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 320/652] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:22 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:23.269521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:23.270136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:23.281865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:23.282310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:23.283174 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:23.283615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:23.428533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:23.436699 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e9ef2ebb-ac83-42ca-838d-f912a82870e0 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.171061 May 27 03:40:23.439603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 333/653] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:23 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:23.816242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-96de5bc0-cb5d-4f62-aa65-b252c6f7ab07 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:23.817055 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-96de5bc0-cb5d-4f62-aa65-b252c6f7ab07 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:23.825235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:23.883679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96de5bc0-cb5d-4f62-aa65-b252c6f7ab07 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:23.890513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-96de5bc0-cb5d-4f62-aa65-b252c6f7ab07 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1240 microversion: 2.1 time: 0.078115 May 27 03:40:23.891120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 321/654] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:23 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:24.149970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-22f60315-d319-4900-9f63-72d47ff62971 req-8667fe40-37bf-4a2b-be97-6e1ed3520706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526d125-8b79-4f3f-8c07-c9b77ecbc2f5", "tag": "d213f02d-0498-429f-ac43-252d863eb6ad"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:24.160094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-22f60315-d319-4900-9f63-72d47ff62971 req-8667fe40-37bf-4a2b-be97-6e1ed3520706 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:24.160612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-22f60315-d319-4900-9f63-72d47ff62971 req-8667fe40-37bf-4a2b-be97-6e1ed3520706 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:24.172478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-22f60315-d319-4900-9f63-72d47ff62971 req-8667fe40-37bf-4a2b-be97-6e1ed3520706 service nova] Creating event network-changed:d213f02d-0498-429f-ac43-252d863eb6ad for instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 on hv-cinder-82880 May 27 03:40:24.179114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-22f60315-d319-4900-9f63-72d47ff62971 req-8667fe40-37bf-4a2b-be97-6e1ed3520706 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033488 May 27 03:40:24.179800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 334/655] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:24.458436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:24.459093 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:24.466540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:24.467028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:24.467801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:24.468234 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:24.638147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:24.646605 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aedf169a-984b-4ea9-9ab3-3ca777d89d29 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.195576 May 27 03:40:24.649596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 322/656] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:24 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:24.908302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:24.910065 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:24.916173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:24.916621 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:24.917388 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:24.917815 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:24.983816 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:24.991672 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-de9d3d6a-a562-4529-8a0d-649ed0d0f188 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1292 microversion: 2.1 time: 0.087925 May 27 03:40:24.992237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 335/657] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:24 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:25.664458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:25.665063 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:25.671654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:25.672135 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:25.672878 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:25.673360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:25.802529 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:25.810194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-02485d26-53e2-4800-8627-7d11eb0ea8fa tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.150194 May 27 03:40:25.810770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 323/658] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:25 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:26.012971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:26.014063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:26.026187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:26.027037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:26.028412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:26.029007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:26.109776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:26.117348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-353b9cd2-0a18-496d-bf28-02a193e93db2 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1298 microversion: 2.1 time: 0.112982 May 27 03:40:26.117925 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 336/659] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:26 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:26.193711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-9a4797e4-457c-45c4-8751-ebe6f4f76658 req-7bf0c7dd-1f6a-492d-9d62-71df7f63cc9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526d125-8b79-4f3f-8c07-c9b77ecbc2f5", "tag": "d213f02d-0498-429f-ac43-252d863eb6ad"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:26.202649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9a4797e4-457c-45c4-8751-ebe6f4f76658 req-7bf0c7dd-1f6a-492d-9d62-71df7f63cc9e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:26.203127 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9a4797e4-457c-45c4-8751-ebe6f4f76658 req-7bf0c7dd-1f6a-492d-9d62-71df7f63cc9e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:26.214389 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-9a4797e4-457c-45c4-8751-ebe6f4f76658 req-7bf0c7dd-1f6a-492d-9d62-71df7f63cc9e service nova] Creating event network-changed:d213f02d-0498-429f-ac43-252d863eb6ad for instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 on hv-cinder-82880 May 27 03:40:26.219498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-9a4797e4-457c-45c4-8751-ebe6f4f76658 req-7bf0c7dd-1f6a-492d-9d62-71df7f63cc9e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030028 May 27 03:40:26.220277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 324/660] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:26.828286 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:26.829039 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:26.836795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:26.837281 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:26.838201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:26.838661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:26.982643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:26.990800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-759a1dd0-f63c-4894-990f-53ef94d0e484 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.166461 May 27 03:40:26.991778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 337/661] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:26 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:27.137741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:27.138426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:27.144716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:27.145185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:27.146070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:27.146525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:27.290243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:27.298472 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9f15d182-aa09-4a86-9ca1-19a077b52a0c tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.165292 May 27 03:40:27.299656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 325/662] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:27 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:27.533518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-9d589a8e-e556-47d3-bce4-168af1aa62d0 req-12c99a52-63b3-4439-9709-7cfb4d89a7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c468d59-f3a1-44de-8052-3b6b651ea73e", "tag": "7de6ae85-3bb0-4331-96a8-95d107a33391"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:27.545387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9d589a8e-e556-47d3-bce4-168af1aa62d0 req-12c99a52-63b3-4439-9709-7cfb4d89a7e7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:27.545825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-9d589a8e-e556-47d3-bce4-168af1aa62d0 req-12c99a52-63b3-4439-9709-7cfb4d89a7e7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:27.563269 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-9d589a8e-e556-47d3-bce4-168af1aa62d0 req-12c99a52-63b3-4439-9709-7cfb4d89a7e7 service nova] Creating event network-changed:7de6ae85-3bb0-4331-96a8-95d107a33391 for instance 3c468d59-f3a1-44de-8052-3b6b651ea73e on hv-cinder-82880 May 27 03:40:27.565366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-9d589a8e-e556-47d3-bce4-168af1aa62d0 req-12c99a52-63b3-4439-9709-7cfb4d89a7e7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038587 May 27 03:40:27.566280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 338/663] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:28.011017 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:28.011665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:28.018751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:28.019318 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:28.020595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:28.021038 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:28.159528 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:28.167349 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cb515a41-2c9a-4f45-854b-68ced6555fda tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.162883 May 27 03:40:28.167872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 326/664] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:28 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:28.316751 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:28.317952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:28.324327 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:28.324781 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:28.325545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:28.325987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:28.461632 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:28.470347 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-12bac6a0-1c73-4059-8ec4-42b7d311ad28 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.157788 May 27 03:40:28.471080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 339/665] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:28 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:29.183846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:29.184452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:29.190953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:29.191400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:29.192800 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:29.193230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:29.324431 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:29.332224 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bac2c3b2-4a2e-41dd-a7e9-67af0188313e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.152121 May 27 03:40:29.332716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 327/666] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:29 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:29.487113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:29.487723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:29.490672 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:29.495649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:29.496102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:29.496866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:29.497308 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:29.623775 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:29.631547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5a25af19-361b-45dd-a861-9db46b7b07e5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.148317 May 27 03:40:29.632120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 340/667] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:29 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:30.349401 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:30.349939 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:30.356636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:30.357112 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:30.357855 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:30.358282 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:30.503086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:30.510818 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-81dd52f5-29f5-4633-bdc3-0b7ee8178df4 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.165342 May 27 03:40:30.511414 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 328/668] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:30 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:30.648699 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:30.649334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:30.655898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:30.656429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:30.657189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:30.657619 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:30.795995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:30.803372 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-46c1355f-6ffd-4d11-a9a5-88f5f3338811 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.158708 May 27 03:40:30.803938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 341/669] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:30 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:31.528717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:31.529334 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:31.536377 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:31.536828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:31.537618 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:31.538052 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:31.668325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:31.675819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-49f3e00b-33e5-4ad4-92e6-9d8dbe1fc5f1 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.151265 May 27 03:40:31.676415 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 329/670] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:31 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:31.820257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:31.820858 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:31.828396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:31.829034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:31.829660 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:31.830440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:31.968302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:31.976481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e35334c7-7385-4f3e-ad6f-8caf46f32414 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.160485 May 27 03:40:31.977097 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 342/671] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:31 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:32.693426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:32.694036 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:32.696443 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:32.701350 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:32.701798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:32.702595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:32.703019 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:32.834000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:32.842071 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7ddd87cc-2ffe-410f-9efc-ebaadf9b4882 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.152567 May 27 03:40:32.842191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 330/672] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:32 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:32.993440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:32.994044 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:33.000880 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:33.001335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:33.002101 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:33.002538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:33.131097 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:33.138487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bd748d3e-ad52-4456-b19b-7a8ceef131bb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.148897 May 27 03:40:33.139179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 343/673] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:32 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:33.478045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-579a0372-6494-4189-9948-726d4402e456 req-cc74a25f-c94f-4e74-824d-066690f0ecdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c468d59-f3a1-44de-8052-3b6b651ea73e", "name": "network-vif-plugged", "status": "completed", "tag": "7de6ae85-3bb0-4331-96a8-95d107a33391"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:33.486190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-579a0372-6494-4189-9948-726d4402e456 req-cc74a25f-c94f-4e74-824d-066690f0ecdc service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:33.486631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-579a0372-6494-4189-9948-726d4402e456 req-cc74a25f-c94f-4e74-824d-066690f0ecdc service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:33.498118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-579a0372-6494-4189-9948-726d4402e456 req-cc74a25f-c94f-4e74-824d-066690f0ecdc service nova] Creating event network-vif-plugged:7de6ae85-3bb0-4331-96a8-95d107a33391 for instance 3c468d59-f3a1-44de-8052-3b6b651ea73e on hv-cinder-82880 May 27 03:40:33.502888 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-579a0372-6494-4189-9948-726d4402e456 req-cc74a25f-c94f-4e74-824d-066690f0ecdc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028536 May 27 03:40:33.503464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 331/674] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:33.859058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:33.859673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:33.865749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:33.866201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:33.867790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:33.867790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:33.998742 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:34.006880 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-aa4f893d-4d1b-4b4b-95e8-a57753fcba08 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.151845 May 27 03:40:34.007455 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 344/675] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:33 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:34.157096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:34.157934 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:34.160975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=14 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:34.167823 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:34.168741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:34.169329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:34.170168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:34.301531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:34.308975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4364c91c-de8b-43a5-a873-ff9c84cf1263 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.157070 May 27 03:40:34.309544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 332/676] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:34 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:35.023644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:35.024257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:35.030923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:35.031330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:35.032099 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:35.032538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:35.169836 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:35.177848 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-519e5373-bcd0-48e4-9292-68605baf49e3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.158043 May 27 03:40:35.178577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 345/677] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:35 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:35.326012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:35.326633 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:35.333928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:35.334384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:35.335168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:35.335604 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:35.462239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:35.469780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c989596b-a05f-4bcc-b650-b35134e4c300 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1366 microversion: 2.1 time: 0.147780 May 27 03:40:35.470341 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 333/678] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:35 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:36.195391 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:36.196062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:36.202740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.203217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.203981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.204416 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.224258 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=100 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:36.338651 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:36.346260 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a4969505-cc15-41bc-aeea-c1ade29d3a79 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1569 microversion: 2.1 time: 0.154822 May 27 03:40:36.346825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 346/679] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:36 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:36.362385 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:36.363075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:36.369985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.370407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.371210 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.371646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.487211 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:36.487775 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:36.493896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.494354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.497703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.497703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.621560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:36.629113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9ffb0890-702a-49cf-b635-0e36a4365b56 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1557 microversion: 2.1 time: 0.145873 May 27 03:40:36.630215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 347/680] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:36 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:36.645952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:36.646891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:36.652345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.652796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.653552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.653987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.702079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dda2fd6e-146c-40b0-bf73-eb30e84878f8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "POST /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.343592 May 27 03:40:36.702760 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 334/681] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:40:36 2022] POST /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:40:36.711294 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:36.711914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:36.718168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.718856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.719637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:36.720295 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:36.729856 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8cb60f4e-8ebc-429c-98ee-ac9fabe627f0 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088113 May 27 03:40:36.730454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 348/682] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:40:36 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:36.977257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:36.985520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b1103e9b-de0e-4f26-9824-980a18291468 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1577 microversion: 2.1 time: 0.278204 May 27 03:40:36.986375 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 335/683] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:36 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:37.427765 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-65ddd8fd-c20f-491e-bf4a-52ffda4cc1de req-ad061e30-9111-4f37-9033-8ef7aab0f61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "name": "network-vif-unplugged", "status": "completed", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:37.437722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-65ddd8fd-c20f-491e-bf4a-52ffda4cc1de req-ad061e30-9111-4f37-9033-8ef7aab0f61c service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:37.438164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-65ddd8fd-c20f-491e-bf4a-52ffda4cc1de req-ad061e30-9111-4f37-9033-8ef7aab0f61c service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:37.449626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.compute.server_external_events [req-65ddd8fd-c20f-491e-bf4a-52ffda4cc1de req-ad061e30-9111-4f37-9033-8ef7aab0f61c service nova] Unable to find a host for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6. Dropping event network-vif-unplugged {{(pid=124770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 03:40:37.450519 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-65ddd8fd-c20f-491e-bf4a-52ffda4cc1de req-ad061e30-9111-4f37-9033-8ef7aab0f61c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028354 May 27 03:40:37.452877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 349/684] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 27 03:40:37.874610 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-819402a5-b71f-4b20-84c9-e3b84a95a3cb req-202790ce-33ea-4a8a-a958-5227f98c465b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c468d59-f3a1-44de-8052-3b6b651ea73e", "tag": "7de6ae85-3bb0-4331-96a8-95d107a33391"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:37.884903 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-819402a5-b71f-4b20-84c9-e3b84a95a3cb req-202790ce-33ea-4a8a-a958-5227f98c465b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:37.885426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-819402a5-b71f-4b20-84c9-e3b84a95a3cb req-202790ce-33ea-4a8a-a958-5227f98c465b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:37.895895 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:37.898379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-819402a5-b71f-4b20-84c9-e3b84a95a3cb req-202790ce-33ea-4a8a-a958-5227f98c465b service nova] Creating event network-changed:7de6ae85-3bb0-4331-96a8-95d107a33391 for instance 3c468d59-f3a1-44de-8052-3b6b651ea73e on hv-cinder-82880 May 27 03:40:37.903620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-819402a5-b71f-4b20-84c9-e3b84a95a3cb req-202790ce-33ea-4a8a-a958-5227f98c465b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095254 May 27 03:40:37.904313 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 336/685] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:38.004850 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:38.005205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:38.011358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:38.011935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:38.012587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:38.013037 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:38.166185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:38.175399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-951d2b3b-c948-4bb4-ab48-77c17856a00e tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1519 microversion: 2.1 time: 0.175268 May 27 03:40:38.177027 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 350/686] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:37 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:39.197245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:39.197972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:39.204520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:39.204965 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:39.205708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:39.206163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:39.342767 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:39.350458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c65c8e49-1246-48d4-a59c-067f0e0dad15 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1519 microversion: 2.1 time: 0.158221 May 27 03:40:39.353322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 337/687] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:39 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:40.370310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:40.371029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:40.378001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:40.378448 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:40.379879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:40.380403 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:40.514702 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:40.523454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c35dbb96-5f70-47b9-b94f-c2d0819ef3fb tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.159389 May 27 03:40:40.524040 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 351/688] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:40 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:41.541576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:41.542190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:41.548751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:41.549205 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:41.549961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:41.550398 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:41.679026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:41.686589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-06cd44a0-eaf6-4858-a03c-c231eefd7e10 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.149295 May 27 03:40:41.687197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 338/689] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:41 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:42.703683 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:42.704290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:42.711598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:42.712043 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:42.712799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:42.713235 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:42.839021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:42.846751 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5216c0bc-1bbc-4785-936b-a46aaf36dc02 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.146899 May 27 03:40:42.847359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 352/690] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:42 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:43.669801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:43.670284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:43.676793 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:43.677233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:43.677984 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:43.678413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:43.701249 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e8047ddf-e11f-4c8d-9fff-f6abef13f160 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/ips" status: 200 len: 152 microversion: 2.20 time: 0.086304 May 27 03:40:43.701794 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 339/691] 10.222.0.24 () {60 vars in 1288 bytes} [Fri May 27 03:40:43 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/ips => generated 152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:40:43.864835 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:43.865422 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:43.871999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:43.872393 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:43.873145 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:43.873573 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:44.021550 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:44.031534 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-efa388ac-d84a-4430-b809-1cb236f343c7 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.170868 May 27 03:40:44.032245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 353/692] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:43 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:45.049488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:45.050092 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:45.056692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:45.057138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:45.057888 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:45.058323 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:45.185306 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:45.193547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3451ee33-dd2f-49ff-af35-fcad1a10997b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.147462 May 27 03:40:45.194129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 340/693] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:45 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:45.766857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:45.767441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:45.773961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:45.774410 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:45.775206 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:45.775646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:45.799848 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lazy-loading 'flavor' on Instance uuid 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:40:46.211472 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:46.212084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:46.218480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:46.218959 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:46.219719 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:46.220166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:46.316809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-78dcb640-922b-4958-91b7-5b085c978f9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/action" status: 202 len: 0 microversion: 2.20 time: 0.553734 May 27 03:40:46.317592 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 354/694] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 27 03:40:45 2022] POST /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:40:46.326490 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:46.327217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:46.339000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:46.339000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:46.339000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:46.339000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:46.375488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:46.383722 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d77b95a1-35f2-45b5-bcbb-fd81ea302a3d tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.177211 May 27 03:40:46.384315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 341/695] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:46 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:46.467451 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:46.475496 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:46.477009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:46.478157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e7420ae7-9b0e-4ce2-b58a-fb96b6689830 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.155937 May 27 03:40:46.478698 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 355/696] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:46 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:47.401499 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:47.402114 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:47.408742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:47.409194 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:47.409955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:47.410438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:47.496916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:47.500059 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:47.507672 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:47.508278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:47.509060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:47.509505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:47.543964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:47.551483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-49e232d1-7e48-4055-9f34-52e849e0c209 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.153929 May 27 03:40:47.552072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 342/697] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:47 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:47.642061 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:47.651003 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:47.652519 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:47.653688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7438dfa3-972f-4cb0-9b43-fa633f706897 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.160668 May 27 03:40:47.654275 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 356/698] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:47 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:40:48.569089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:48.569723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:48.576287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:48.576739 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:48.577487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:48.577920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:48.672280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:48.673059 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:48.679875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:48.680316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:48.681072 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:48.681504 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:48.705423 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:48.714983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-63424edf-6a61-408e-94fd-92b258dceb96 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.149692 May 27 03:40:48.715561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 343/699] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:48 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:48.811326 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:48.819767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:48.821267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:48.822455 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6f9bd95e-0fa1-469b-9f78-2bc1a0d21e0f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.154268 May 27 03:40:48.823035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 357/700] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:48 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:49.732548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:49.733152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:49.739848 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:49.740295 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:49.741050 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:49.741480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:49.841697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:49.842882 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:49.851112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:49.851563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:49.852332 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:49.852762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:49.870561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:49.877931 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bbcf0c7e-7521-440c-80c1-4e04c502497b tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.149253 May 27 03:40:49.878498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 344/701] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:49 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:49.979045 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:49.986955 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:49.988481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:49.989634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d4a179c1-929e-4753-928e-7072baea2e9f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.152668 May 27 03:40:49.990828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 358/702] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:49 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:50.895768 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:50.896407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:50.903549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:50.911109 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:50.911109 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:50.911109 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:51.007529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:51.008205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:51.014678 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:51.015179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:51.015940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:51.016412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:51.053935 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:51.061591 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4c9953fa-c63b-4acd-92ec-cd4c4f1f646f tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.169742 May 27 03:40:51.062177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 345/703] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:50 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:51.160583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:51.170523 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:51.172938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:51.174262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-668966c0-e90d-4de0-a209-29bdcdc492b0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.170631 May 27 03:40:51.174884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 359/704] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:51 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:51.465241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-89044771"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:51.470698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:51.471798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:51.472247 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:51.472995 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:51.473425 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:51.604291 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.network.security_group_api [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Removing security group bfba84b5-b809-480d-a2aa-3a4075f5993f from port f5a040c0-7ee8-466d-bbe9-24fdc9c314fb May 27 03:40:51.605484 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-2d64d9d4-6397-44a5-b154-7096a536c1bf req-62a3b660-5b0a-46bf-9cfe-58fd08023546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "name": "network-vif-plugged", "status": "completed", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:51.616541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-2d64d9d4-6397-44a5-b154-7096a536c1bf req-62a3b660-5b0a-46bf-9cfe-58fd08023546 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:51.619855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-2d64d9d4-6397-44a5-b154-7096a536c1bf req-62a3b660-5b0a-46bf-9cfe-58fd08023546 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:51.628261 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-2d64d9d4-6397-44a5-b154-7096a536c1bf req-62a3b660-5b0a-46bf-9cfe-58fd08023546 service nova] Creating event network-vif-plugged:0aa36f0b-ffa2-488e-b031-21fe9c191622 for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 on hv-cinder-82880 May 27 03:40:51.633251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-2d64d9d4-6397-44a5-b154-7096a536c1bf req-62a3b660-5b0a-46bf-9cfe-58fd08023546 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097634 May 27 03:40:51.634131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 360/705] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:52.072161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2c002739-126d-4b44-8b8f-2decfc2a2ea1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/action" status: 202 len: 0 microversion: 2.1 time: 0.610862 May 27 03:40:52.079057 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 346/706] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:40:51 2022] POST /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:40:52.079514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:52.080236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:52.092895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:52.093359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:52.093902 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-90e2df30-90e0-4e63-aa74-0b8b2fba78b6 req-5b86a8c0-65df-4ce8-97a5-243d27b29983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:52.094364 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:52.095889 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:52.107334 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-90e2df30-90e0-4e63-aa74-0b8b2fba78b6 req-5b86a8c0-65df-4ce8-97a5-243d27b29983 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:52.107788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-90e2df30-90e0-4e63-aa74-0b8b2fba78b6 req-5b86a8c0-65df-4ce8-97a5-243d27b29983 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:52.135927 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-90e2df30-90e0-4e63-aa74-0b8b2fba78b6 req-5b86a8c0-65df-4ce8-97a5-243d27b29983 service nova] Creating event network-changed:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:40:52.163814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-90e2df30-90e0-4e63-aa74-0b8b2fba78b6 req-5b86a8c0-65df-4ce8-97a5-243d27b29983 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073515 May 27 03:40:52.164423 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 347/707] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:52.207525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:52.208225 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:52.218305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:52.218521 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:52.219318 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:52.219792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:52.701077 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:52.709657 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9ec6f81a-0379-4c67-99b4-903ccf5f7ca9 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.634347 May 27 03:40:52.710474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 361/708] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:52 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:52.726245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:52.734107 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:52.735665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:52.736819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-083324e5-5450-43cd-b64c-f2ad00415f7b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.533814 May 27 03:40:52.737380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 348/709] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:52 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:53.727047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:53.727688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:53.734287 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:53.734740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:53.735533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:53.735960 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:53.756707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:53.757962 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:53.764622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:53.765145 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:53.766110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:53.766576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:53.931527 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:53.935697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:53.942204 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e5f892b3-d804-432d-93ad-4dd7226798f6 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1575 microversion: 2.1 time: 0.218967 May 27 03:40:53.951501 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 362/710] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:53 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:53.957420 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:53.957851 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:53.958239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:53.964856 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:53.965314 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:53.966148 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:53.966590 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:53.966985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:53.968615 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:53.969841 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-416393da-75fa-49c8-b69c-0162718205c1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.218078 May 27 03:40:53.970399 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 349/711] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:53 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:54.046242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-5220a0d8-504d-4e16-aabd-36bfa0ce819c req-d68da48b-c8fc-48bf-aa17-883149c7d8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:54.054669 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-5220a0d8-504d-4e16-aabd-36bfa0ce819c req-d68da48b-c8fc-48bf-aa17-883149c7d8a0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:54.055229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-5220a0d8-504d-4e16-aabd-36bfa0ce819c req-d68da48b-c8fc-48bf-aa17-883149c7d8a0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:54.067522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-5220a0d8-504d-4e16-aabd-36bfa0ce819c req-d68da48b-c8fc-48bf-aa17-883149c7d8a0 service nova] Creating event network-changed:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:40:54.071585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lazy-loading 'services' on Instance uuid d324495a-01ec-4ed8-bec2-76575ce7a541 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:40:54.073774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-5220a0d8-504d-4e16-aabd-36bfa0ce819c req-d68da48b-c8fc-48bf-aa17-883149c7d8a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100583 May 27 03:40:54.074590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 350/712] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:54.335893 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0c44bff9-d429-4881-aae6-ed8061a533c7 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments/14491733-d2c2-4585-a1c9-3d5fd981cfb9" status: 202 len: 0 microversion: 2.1 time: 0.382549 May 27 03:40:54.339550 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 363/713] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:40:53 2022] DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments/14491733-d2c2-4585-a1c9-3d5fd981cfb9 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:40:54.346450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:54.348528 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:54.362490 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:54.363130 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:54.367151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:54.367868 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:54.398828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-64bf7eeb-a958-44b5-a7dd-6430c6c2bf2f tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057265 May 27 03:40:54.399552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 351/714] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:40:54 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:54.961008 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:54.961713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:54.968499 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:54.968950 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:54.969710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:54.970144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:54.992987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:54.993747 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:54.997477 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=64 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.001651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:55.002108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:55.002907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:55.003479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:55.170706 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:55.179753 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8fc67326-0c60-46e8-9998-2a104878aaf5 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1562 microversion: 2.1 time: 0.223505 May 27 03:40:55.180375 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 364/715] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:54 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:55.197349 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:55.205354 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:55.207228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:55.208402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-96d08d1e-b61a-4aad-87b9-06a8234d15e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.219920 May 27 03:40:55.209589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 352/716] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:54 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:40:55.410999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:55.412524 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:55.418723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:55.423058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:55.423058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:55.423058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:55.449622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d891cf0e-3990-4ded-80e8-5d253535404b tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 May 27 03:40:55.450188 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 365/717] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:40:55 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:56.226735 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:56.227382 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:56.233872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:56.234319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:56.235131 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:56.235561 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:56.377210 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:56.385683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:56.387245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:56.388395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c3622e5b-49a4-4b85-806e-5151e0a2f88c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.165601 May 27 03:40:56.388953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 353/718] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:56 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:40:56.461030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:56.461949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:56.468593 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:56.469038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:56.469789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:56.470221 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:56.498821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6a0a92a2-c64c-4b51-a73d-456fd564748d tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042003 May 27 03:40:56.499415 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 366/719] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:40:56 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:40:56.509505 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:56.510000 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:56.515936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:56.516385 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:56.517140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:56.517572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:56.590527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] HTTP exception thrown: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 is not attached to volume 14491733-d2c2-4585-a1c9-3d5fd981cfb9 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Request method failure captured: May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments/14491733-d2c2-4585-a1c9-3d5fd981cfb9 HTTP/1.1 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEeKlkm01K492nt2aAVQ4DfL8LRBZKvNHbAOPtRBP0YRKpgzmUPmU5D5SWT84R-sqGov70A9PZszan7BMOL9itCvcU5n5kzOQUBBuImMvOM36TiSv6gemuOSAHbCSpSX902KJSajsCbhFzz9BiUSh7An5ub0tVKMJ63Sa691k3Va99o May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 99d82d4c868f404e9bc7e932aadf7670 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestMinimumBasicScenario-2088633217 May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:40:56.608904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_99d82d4c868f404e9bc7e932aadf7670", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/99d82d4c868f404e9bc7e932aadf7670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/99d82d4c868f404e9bc7e932aadf7670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/99d82d4c868f404e9bc7e932aadf7670"}]}] May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestMinimumBasicScenario-2088633217 May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 99d82d4c868f404e9bc7e932aadf7670 May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2088633217 May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-TestMinimumBasicScenario-2088633217-project May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: c81a63ee15d843bfb857a7f3148015e8 May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestMinimumBasicScenario-2088633217-project May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:40:56.610482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 is not attached to volume 14491733-d2c2-4585-a1c9-3d5fd981cfb9 May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'server_id': 'd324495a-01ec-4ed8-bec2-76575ce7a541', 'id': '14491733-d2c2-4585-a1c9-3d5fd981cfb9'} May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 14491733-d2c2-4585-a1c9-3d5fd981cfb9. May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:40:56.611369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 is not attached to volume 14491733-d2c2-4585-a1c9-3d5fd981cfb9 May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 is not attached to volume 14491733-d2c2-4585-a1c9-3d5fd981cfb9 May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:40:56.612811 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Returning 404 to user: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 is not attached to volume 14491733-d2c2-4585-a1c9-3d5fd981cfb9 {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:40:56.613862 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8ad61556-71aa-49aa-acf9-c15e335b491a tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments/14491733-d2c2-4585-a1c9-3d5fd981cfb9" status: 404 len: 154 microversion: 2.1 time: 0.105340 May 27 03:40:56.613862 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 354/720] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:40:56 2022] DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541/os-volume_attachments/14491733-d2c2-4585-a1c9-3d5fd981cfb9 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:40:57.406733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:57.407290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:57.413842 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:57.414277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:57.415082 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:57.415520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:57.541978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:57.549956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:57.551511 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:57.552691 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7bf757dc-0157-4485-bb6e-7acf6c05d41b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.150076 May 27 03:40:57.553262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 367/721] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:57 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:40:57.897026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:57.897523 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:57.904070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:57.904514 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:57.905266 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:57.905697 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:57.923840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:57.930712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:40:58.260397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-820f4789-7dc0-4c5c-9805-cd5f84cca970 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 204 len: 0 microversion: 2.1 time: 0.366775 May 27 03:40:58.260916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 355/722] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:40:57 2022] DELETE /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:40:58.272928 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:58.273536 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:58.279732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:58.280171 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:58.280917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:58.281339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:58.415949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:58.423982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5f95da7b-baef-4a1a-9149-9116b261840c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1554 microversion: 2.1 time: 0.154923 May 27 03:40:58.424562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 368/723] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:58 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:58.571643 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:58.572345 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:58.578371 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:58.578822 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:58.579606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:58.580044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:58.709501 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:58.717450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:58.718995 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:58.720150 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eb1c271f-c110-4235-960f-9027b45bd5a4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.152797 May 27 03:40:58.720707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 356/724] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:58 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:40:59.442914 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:59.443937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:59.450710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:59.451193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:59.451956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:59.452390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:59.575115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:59.582861 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-10be0de5-c90e-4673-a8a9-a613e30bab17 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1554 microversion: 2.1 time: 0.144026 May 27 03:40:59.583462 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 369/725] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:40:59 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1554 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:59.739240 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:59.740397 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:40:59.746963 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:59.747406 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:59.748151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:40:59.748580 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:40:59.875311 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:59.883185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:59.884699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:59.885845 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2fa4ad61-45d9-4e39-9919-6bd933d95117 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.150867 May 27 03:40:59.886404 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 357/726] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:40:59 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:00.600013 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.600596 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:00.603004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=60 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:00.607834 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:00.608276 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:00.611580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:00.611580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:00.739546 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:00.747634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6a5550f4-6aa1-4607-8f04-b87d98f962cb tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1554 microversion: 2.1 time: 0.151531 May 27 03:41:00.748200 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 370/727] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:00 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:00.904314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.904949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:00.911700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:00.912154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:00.912950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:00.913386 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:01.039362 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:01.047462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:01.049003 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:01.050148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9f05dcfa-37fa-4673-b79b-0fe4094621ab tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.149751 May 27 03:41:01.050716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 358/728] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:00 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:01.124988 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-abd73e23-951f-449b-9b03-34fde845e769 req-f7c3e2c7-7aa3-4a2f-adab-efa5acfec66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d324495a-01ec-4ed8-bec2-76575ce7a541", "name": "network-vif-deleted", "tag": "f5a040c0-7ee8-466d-bbe9-24fdc9c314fb"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:01.133755 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-abd73e23-951f-449b-9b03-34fde845e769 req-f7c3e2c7-7aa3-4a2f-adab-efa5acfec66b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:01.134201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-abd73e23-951f-449b-9b03-34fde845e769 req-f7c3e2c7-7aa3-4a2f-adab-efa5acfec66b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:01.145317 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-abd73e23-951f-449b-9b03-34fde845e769 req-f7c3e2c7-7aa3-4a2f-adab-efa5acfec66b service nova] Creating event network-vif-deleted:f5a040c0-7ee8-466d-bbe9-24fdc9c314fb for instance d324495a-01ec-4ed8-bec2-76575ce7a541 on hv-cinder-82880 May 27 03:41:01.150617 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-abd73e23-951f-449b-9b03-34fde845e769 req-f7c3e2c7-7aa3-4a2f-adab-efa5acfec66b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029422 May 27 03:41:01.151230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 371/729] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:01.765445 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:01.765915 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:01.772139 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:01.772579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:01.773325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:01.773751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:01.806013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:01.806456 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:01.806919 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lazy-loading 'fault' on Instance uuid d324495a-01ec-4ed8-bec2-76575ce7a541 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:41:01.848196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81a63ee15d843bfb857a7f3148015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d82d4c868f404e9bc7e932aadf7670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:01.856236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e5a61208-b205-439e-92e0-47b4255233f1 tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 200 len: 1348 microversion: 2.1 time: 0.094858 May 27 03:41:01.856806 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 359/730] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:01 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:02.036034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.037293 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:02.043572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.044022 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.044781 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.045217 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.069253 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.070005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:02.076680 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.077132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.077901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.078528 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.136036 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lazy-loading 'services' on Instance uuid 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:41:02.217606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:02.225103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:02.226664 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:02.227851 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-607672d6-d17f-46d3-a7ff-1fc89e415de0 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.162531 May 27 03:41:02.228416 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 360/731] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:02 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:02.431847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-470f9c8f-d3b7-4718-9606-c739017e08fb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments/d4b08005-b4ba-48f1-99a2-68f67a848f22" status: 202 len: 0 microversion: 2.1 time: 0.400701 May 27 03:41:02.432487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 372/732] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:41:02 2022] DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments/d4b08005-b4ba-48f1-99a2-68f67a848f22 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:41:02.440730 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.441728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:02.448364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.448812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.449559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.449989 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.479095 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f7707813-35e5-427a-b162-f63196e995ac tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042187 May 27 03:41:02.479667 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 361/733] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:02 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:02.876406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.877045 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] [instance: d324495a-01ec-4ed8-bec2-76575ce7a541] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:02.883473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.883923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.884679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:02.885116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:02.898211 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] HTTP exception thrown: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 could not be found. May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Request method failure captured: May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 HTTP/1.1 May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEeKlkm01K492nt2aAVQ4DfL8LRBZKvNHbAOPtRBP0YRKpgzmUPmU5D5SWT84R-sqGov70A9PZszan7BMOL9itCvcU5n5kzOQUBBuImMvOM36TiSv6gemuOSAHbCSpSX902KJSajsCbhFzz9BiUSh7An5ub0tVKMJ63Sa691k3Va99o May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 99d82d4c868f404e9bc7e932aadf7670 May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestMinimumBasicScenario-2088633217 May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:41:02.899823 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_99d82d4c868f404e9bc7e932aadf7670", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/99d82d4c868f404e9bc7e932aadf7670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/99d82d4c868f404e9bc7e932aadf7670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/99d82d4c868f404e9bc7e932aadf7670"}]}] May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestMinimumBasicScenario-2088633217 May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 99d82d4c868f404e9bc7e932aadf7670 May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2088633217 May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-TestMinimumBasicScenario-2088633217-project May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: c81a63ee15d843bfb857a7f3148015e8 May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestMinimumBasicScenario-2088633217-project May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 could not be found. May 27 03:41:02.901400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'd324495a-01ec-4ed8-bec2-76575ce7a541'} May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 could not be found. May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:02.902431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 could not be found. May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 could not be found. May 27 03:41:02.903908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:02.905299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Returning 404 to user: Instance d324495a-01ec-4ed8-bec2-76575ce7a541 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:02.905299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-319b2418-61d6-4453-b824-d5644320644c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541" status: 404 len: 111 microversion: 2.1 time: 0.029137 May 27 03:41:02.905299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 373/734] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:02 2022] GET /compute/v2.1/servers/d324495a-01ec-4ed8-bec2-76575ce7a541 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:02.910231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-16ba1708-26f8-4b79-b123-3fd0b16c689c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] Calling method '.version_select at 0x7f3046807940>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.999019 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-16ba1708-26f8-4b79-b123-3fd0b16c689c tempest-TestMinimumBasicScenario-2088633217 tempest-TestMinimumBasicScenario-2088633217-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1485130258" status: 202 len: 0 microversion: 2.1 time: 0.092460 May 27 03:41:02.999601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 362/735] 10.222.0.24 () {58 vars in 1271 bytes} [Fri May 27 03:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1485130258 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:41:03.246056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:03.246664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:03.253290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:03.253743 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:03.254505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:03.255022 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:03.399345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:03.410253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:03.411132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:03.412007 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ed4819ec-684d-40b5-a506-b2c46602f811 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1746 microversion: 2.20 time: 0.169976 May 27 03:41:03.412551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 374/736] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:03 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:03.490714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:03.491703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:03.498964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:03.501674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:03.501674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:03.501674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:03.529637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9c3781c5-b04f-4404-a2d5-ffebc21032d2 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 May 27 03:41:03.530403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 363/737] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:03 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:04.431982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:04.432626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:04.439343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:04.439796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:04.440569 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:04.441018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:04.542325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:04.543276 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:04.550086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:04.550538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:04.551475 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:04.551797 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:04.576203 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:04.580358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6a47bb09-320d-443f-b3ed-d4a900a22f56 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042595 May 27 03:41:04.580932 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 364/738] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:04 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:41:04.585161 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:04.587314 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:04.588540 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-497de035-d086-4695-85bc-7aa257f06a13 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1746 microversion: 2.20 time: 0.160577 May 27 03:41:04.589085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 375/739] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:04 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:04.653597 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:04.654231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:04.660370 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:04.660756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:04.661508 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:04.662140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:04.686861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:41:05.043795 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2921808b-c0ab-4390-970c-ac8e9c316cf1 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 204 len: 0 microversion: 2.1 time: 0.394493 May 27 03:41:05.044577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 365/740] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:04 2022] DELETE /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:41:05.052433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:05.053050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:05.059883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:05.060339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:05.063494 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:05.063494 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:05.316533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:05.324716 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-749415a4-0c96-4077-bb68-51b56dec51e5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1689 microversion: 2.1 time: 0.276219 May 27 03:41:05.325299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 376/741] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:05 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1689 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:05.608126 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:05.608814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:05.615346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:05.615790 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:05.617096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:05.617537 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:05.860626 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:05.871638 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:05.873553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:05.875222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b371b740-117b-4707-bd0b-d5b16289ca80 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1746 microversion: 2.20 time: 0.271406 May 27 03:41:05.880575 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 366/742] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:05 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1746 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:06.342869 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:06.343426 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:06.350681 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:06.351164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:06.352089 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:06.352530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:06.528771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:06.536912 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-502e14b9-5266-456d-ad20-265e3ccb623f tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1689 microversion: 2.1 time: 0.198388 May 27 03:41:06.537915 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 377/743] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:06 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:06.893677 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:06.894384 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:06.901535 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:06.901979 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:06.902752 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:06.903217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:07.194095 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:07.202861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:07.204469 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:07.205725 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-66c51dff-e256-4e57-901e-653ad7d36b4e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1746 microversion: 2.20 time: 0.316057 May 27 03:41:07.206362 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 367/744] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:06 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1746 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:07.553948 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:07.554813 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:07.561509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:07.562021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:07.567714 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:07.567714 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:07.633334 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-b7c97c5f-f8d2-47da-8d57-61d6f9f47374 req-34aa6050-8afe-4022-82ad-7baadfe782b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "name": "network-vif-plugged", "status": "completed", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:07.657457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-b7c97c5f-f8d2-47da-8d57-61d6f9f47374 req-34aa6050-8afe-4022-82ad-7baadfe782b4 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:07.657897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-b7c97c5f-f8d2-47da-8d57-61d6f9f47374 req-34aa6050-8afe-4022-82ad-7baadfe782b4 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:07.671595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-b7c97c5f-f8d2-47da-8d57-61d6f9f47374 req-34aa6050-8afe-4022-82ad-7baadfe782b4 service nova] Creating event network-vif-plugged:ee7bf9c2-a2d0-4695-960b-55515919a177 for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 on hv-cinder-82880 May 27 03:41:07.676821 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-b7c97c5f-f8d2-47da-8d57-61d6f9f47374 req-34aa6050-8afe-4022-82ad-7baadfe782b4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048026 May 27 03:41:07.677436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 368/745] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:07.869425 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:07.877354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-13e3886e-77ef-4834-bf9f-8647e95155dd tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1689 microversion: 2.1 time: 0.327343 May 27 03:41:07.879317 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 378/746] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:07 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1689 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:08.225010 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:08.225840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:08.232538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:08.232987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:08.233742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:08.234171 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:08.376752 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:08.386242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:08.388046 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:08.389231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7a041dd6-44a8-4974-ab26-6fe9ea87692d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1746 microversion: 2.20 time: 0.168660 May 27 03:41:08.400140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 369/747] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:08 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:08.895456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:08.895971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:08.902497 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:08.902973 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:08.903733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:08.904163 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:08.922828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:09.127011 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:09.141676 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9c803df4-833f-429c-9b0f-1186984a4251 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1689 microversion: 2.1 time: 0.250093 May 27 03:41:09.143541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 379/748] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:08 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:09.410646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:09.412435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:09.419990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:09.420652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:09.421570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:09.422347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:09.453797 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:09.629557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:09.636734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:09.638522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:09.639713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c2ea3bbe-026d-4abc-b3f5-e2fcc067b79c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.234874 May 27 03:41:09.640440 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 370/749] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:09 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:09.873845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-c6a350cf-27f1-4cdd-be9b-a7b13a7ce7d1 req-071af3af-1791-490a-9c97-9970d038a625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8526d125-8b79-4f3f-8c07-c9b77ecbc2f5", "name": "network-vif-deleted", "tag": "d213f02d-0498-429f-ac43-252d863eb6ad"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:09.883274 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-c6a350cf-27f1-4cdd-be9b-a7b13a7ce7d1 req-071af3af-1791-490a-9c97-9970d038a625 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:09.893126 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-c6a350cf-27f1-4cdd-be9b-a7b13a7ce7d1 req-071af3af-1791-490a-9c97-9970d038a625 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:09.895541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-c6a350cf-27f1-4cdd-be9b-a7b13a7ce7d1 req-071af3af-1791-490a-9c97-9970d038a625 service nova] Creating event network-vif-deleted:d213f02d-0498-429f-ac43-252d863eb6ad for instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 on hv-cinder-82880 May 27 03:41:09.912055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-c6a350cf-27f1-4cdd-be9b-a7b13a7ce7d1 req-071af3af-1791-490a-9c97-9970d038a625 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 May 27 03:41:09.915778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 380/750] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:10.160103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:10.160889 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:10.170403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:10.180720 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:10.182529 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:10.183226 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:10.343191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:10.351903 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f2553f80-fd04-4054-8996-0c002498adb5 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 200 len: 1329 microversion: 2.1 time: 0.196108 May 27 03:41:10.353148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 371/751] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:10 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 1329 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:10.664553 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:10.667670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:10.685887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:10.690060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:10.691547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:10.692765 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:10.904530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:10.917385 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:10.919757 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:10.921374 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0224ae57-51bf-4248-a52c-46d400b2b8f8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.266534 May 27 03:41:10.922252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 381/752] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:10 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:11.368601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:11.369511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:11.380298 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:11.381206 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:11.382233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:11.383264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:11.405047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] HTTP exception thrown: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 could not be found. May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Request method failure captured: May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 HTTP/1.1 May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEdJle72uA52wRzl38Wo43jLfBUD8_6-W2I-TixspRM8trW4-_2haG8mfc5F9L3Xi5Bqj3rHIho7SA8IGXv5IHFoJA36ducSbafluUVIdz287TsaM13us68tDUJkPJf9fZzmKloTmtdMm-Skgg0llpRkAvVz2pqCiat4SA7MX--FAis May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:11.408707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_03b1335715234895a0c1a555b22ee8d3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/03b1335715234895a0c1a555b22ee8d3"}]}] May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: b2671aaae84644acb89c3c3595bb5673 May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 could not be found. May 27 03:41:11.410360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '8526d125-8b79-4f3f-8c07-c9b77ecbc2f5'} May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 could not be found. May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:11.411376 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 could not be found. May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 could not be found. May 27 03:41:11.412683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:11.416490 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Returning 404 to user: Instance 8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:11.417589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9909c3fe-1fef-4ae2-b406-8b1729dc2588 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5" status: 404 len: 111 microversion: 2.1 time: 0.053002 May 27 03:41:11.418777 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 372/753] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:11 2022] GET /compute/v2.1/servers/8526d125-8b79-4f3f-8c07-c9b77ecbc2f5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:11.431631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7a1e27f7-9aa9-431f-81e4-d9a76cf4090a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '.version_select at 0x7f30465e78b0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:11.531519 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7a1e27f7-9aa9-431f-81e4-d9a76cf4090a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243003399" status: 202 len: 0 microversion: 2.1 time: 0.108853 May 27 03:41:11.532910 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 382/754] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 27 03:41:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243003399 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:41:11.940737 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:11.941423 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:11.951728 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:11.952178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:11.954941 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:11.958866 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:12.221142 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:12.232454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:12.234322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:12.239070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-41d6413d-c143-4535-be6b-be50e42b08f9 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.302625 May 27 03:41:12.239963 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 373/755] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:11 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:13.259707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:13.260313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:13.274535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:13.274535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:13.274535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:13.274896 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:13.551764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:13.570313 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:13.572008 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:13.573301 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a3554a52-6b6a-4a0c-b2d1-f20ac68d6bf2 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.319359 May 27 03:41:13.579372 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 383/756] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:13 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:14.598673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:14.599404 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:14.608147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:14.609060 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:14.610162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:14.610784 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:14.769534 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:14.783563 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:14.790635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:14.792535 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6327675f-ede0-4f1d-944b-2f2c9f833088 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.198717 May 27 03:41:14.793106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 374/757] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:14 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:15.757544 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:15.758241 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:15.771181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:15.772038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:15.773559 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:15.774281 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:15.820590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:15.822136 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:15.840733 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:15.845342 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:15.846562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:15.847508 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:15.862446 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:41:16.085671 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:16.095281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:16.097072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:16.098758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cc2004e8-08a4-467b-a253-a84e995e6d1c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.285356 May 27 03:41:16.099568 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 375/758] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:15 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:16.227035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bc28c6b4-b907-401c-9cfa-e88785572f73 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 204 len: 0 microversion: 2.1 time: 0.473635 May 27 03:41:16.227902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 384/759] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:15 2022] DELETE /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:41:16.245769 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:16.247244 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:16.261280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:16.261833 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:16.262916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:16.263456 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:16.446528 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:16.456414 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e141dff9-da5d-4cb3-aa74-c52b64b5f628 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1508 microversion: 2.1 time: 0.218099 May 27 03:41:16.458329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 376/760] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:16 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:17.119779 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:17.121257 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:17.129144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:17.129597 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:17.130555 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:17.131187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:17.283745 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:17.294359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:17.295992 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:17.297273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6f437c0e-87a0-4a97-a7b0-bf47d21ffdbb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.183114 May 27 03:41:17.297853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 385/761] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:17 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:17.476236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:17.477495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:17.484739 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:17.485195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:17.485979 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:17.486418 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:17.624819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:17.632821 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0934e574-2239-455d-830a-c9219933a7d0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1508 microversion: 2.1 time: 0.161334 May 27 03:41:17.633413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 377/762] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:17 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:18.317530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:18.318131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:18.330013 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:18.330383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:18.331390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:18.331829 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:18.649749 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:18.650297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:18.657151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:18.657590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:18.658534 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:18.659142 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:18.857472 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:18.867708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:18.869547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:18.870979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7c96b2db-7bd9-4c68-837b-2c1a17e7f445 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.557659 May 27 03:41:18.882703 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 386/763] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:18 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:18.893006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:18.902599 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-763c197f-0715-4551-bf89-4038a43296f0 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1508 microversion: 2.1 time: 0.255962 May 27 03:41:18.904898 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 378/764] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:18 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:19.565546 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-b522ebf6-f885-4951-b80f-7ff1ae329542 req-a1a515a0-8fd0-4877-988a-3deb66095856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94909255-c0eb-42c8-86f4-d3622d539f0c", "name": "network-vif-deleted", "tag": "0b783256-36f5-4ea7-b360-d6d1ff32af14"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:19.581394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b522ebf6-f885-4951-b80f-7ff1ae329542 req-a1a515a0-8fd0-4877-988a-3deb66095856 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:19.582336 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-b522ebf6-f885-4951-b80f-7ff1ae329542 req-a1a515a0-8fd0-4877-988a-3deb66095856 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:19.612866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-b522ebf6-f885-4951-b80f-7ff1ae329542 req-a1a515a0-8fd0-4877-988a-3deb66095856 service nova] Creating event network-vif-deleted:0b783256-36f5-4ea7-b360-d6d1ff32af14 for instance 94909255-c0eb-42c8-86f4-d3622d539f0c on hv-cinder-82880 May 27 03:41:19.624579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-b522ebf6-f885-4951-b80f-7ff1ae329542 req-a1a515a0-8fd0-4877-988a-3deb66095856 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062739 May 27 03:41:19.625773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 387/765] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:19.894482 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:19.895726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:19.903163 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:19.903607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:19.904379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:19.904804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:19.923042 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:19.924030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:19.935768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:19.936494 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:19.937470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:19.938075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:20.014653 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:20.015133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:20.015600 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lazy-loading 'fault' on Instance uuid 94909255-c0eb-42c8-86f4-d3622d539f0c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:41:20.085917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:20.097629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-605b9bb3-8170-4071-9fd1-f6bcc19b7347 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 200 len: 1312 microversion: 2.1 time: 0.181020 May 27 03:41:20.108577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 388/766] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:19 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:20.117411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:20.126165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:20.127527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:20.128711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-470c3344-d8d7-4e08-aed0-9e0fd4451b42 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.242821 May 27 03:41:20.139388 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 379/767] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:19 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:21.116526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:21.117218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: 94909255-c0eb-42c8-86f4-d3622d539f0c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:21.124143 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.124601 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.125376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.125818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.140299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] HTTP exception thrown: Instance 94909255-c0eb-42c8-86f4-d3622d539f0c could not be found. May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Request method failure captured: May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c HTTP/1.1 May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEdJle72uA52wRzl38Wo43jLfBUD8_6-W2I-TixspRM8trW4-_2haG8mfc5F9L3Xi5Bqj3rHIho7SA8IGXv5IHFoJA36ducSbafluUVIdz287TsaM13us68tDUJkPJf9fZzmKloTmtdMm-Skgg0llpRkAvVz2pqCiat4SA7MX--FAis May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:41:21.141949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_03b1335715234895a0c1a555b22ee8d3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/03b1335715234895a0c1a555b22ee8d3"}]}] May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: b2671aaae84644acb89c3c3595bb5673 May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 94909255-c0eb-42c8-86f4-d3622d539f0c could not be found. May 27 03:41:21.143226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '94909255-c0eb-42c8-86f4-d3622d539f0c'} May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94909255-c0eb-42c8-86f4-d3622d539f0c could not be found. May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:21.143937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94909255-c0eb-42c8-86f4-d3622d539f0c could not be found. May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94909255-c0eb-42c8-86f4-d3622d539f0c could not be found. May 27 03:41:21.145341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:21.146723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Returning 404 to user: Instance 94909255-c0eb-42c8-86f4-d3622d539f0c could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:21.146723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8284fbeb-a628-48d5-837a-56af2a05d451 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c" status: 404 len: 111 microversion: 2.1 time: 0.031745 May 27 03:41:21.146723 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 389/768] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:21 2022] GET /compute/v2.1/servers/94909255-c0eb-42c8-86f4-d3622d539f0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:21.147283 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:21.148010 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:21.151857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:21.152354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:21.154598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.155125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.155845 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.156277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.158515 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.158929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.159695 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.160364 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.202976 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:41:21.300525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:21.304231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:21.305860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:21.307097 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-469bbc04-7ee7-4a38-b584-bdb9622fe319 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.164024 May 27 03:41:21.307686 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 380/769] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:21 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:21.792884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-155e5790-ada9-45af-aeef-b6d9f9ba47aa tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 204 len: 0 microversion: 2.1 time: 0.643920 May 27 03:41:21.793648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 390/770] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:21 2022] DELETE /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:41:21.804096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:21.806008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:21.811097 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.812148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.813125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:21.813565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:21.978588 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:21.988361 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c7824632-0f92-4be5-aca9-a3441d828ecb tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.190131 May 27 03:41:21.989407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 381/771] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:21 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:22.326310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:22.326927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:22.335751 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:22.336201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:22.336986 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:22.337591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:22.471927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:22.480549 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:22.482046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:22.483237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24b4828b-8435-4e50-8d63-4e1aca1bd309 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.161502 May 27 03:41:22.483788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 391/772] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:22 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:23.007341 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:23.007867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:23.014298 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:23.014738 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:23.015526 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:23.015955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:23.149889 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.157429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0bf7fcb4-d4b8-473f-984f-d2f055013ab9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.154557 May 27 03:41:23.158316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 382/773] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:23 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:23.501381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:23.502025 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:23.509263 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:23.509712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:23.510478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:23.510941 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:23.640899 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.652088 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.655053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.655913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6df1ced5-c057-4213-a7a0-6727d1cf39c6 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.158407 May 27 03:41:23.656692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 392/774] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:23 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:24.174798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:24.175435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:24.182343 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:24.182792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:24.186288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:24.186288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:24.314272 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:24.321714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9504394b-1dbb-472e-b11d-c87852077ada tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.150807 May 27 03:41:24.322280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 383/775] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:24 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:24.655559 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:24.656408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:24.668439 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:24.669295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:24.670657 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:24.671487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:24.676126 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:24.676745 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:24.683578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:24.684022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:24.684790 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:24.685236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:24.704373 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9895f576-cbb1-4464-8dff-e7bda35c5b95 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/ips" status: 200 len: 150 microversion: 2.1 time: 0.053885 May 27 03:41:24.704957 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 393/776] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:41:24 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:24.818363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:24.826545 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:24.828744 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:24.829912 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-416a4f2c-2e9e-45cb-8835-6f23366aea84 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1741 microversion: 2.20 time: 0.157909 May 27 03:41:24.830483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 384/777] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:24 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:25.338400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:25.339046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:25.346984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:25.347576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:25.350033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:25.350033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:25.493929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.501563 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4272e9b9-7153-43cb-b542-29403cc4db64 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1523 microversion: 2.1 time: 0.167468 May 27 03:41:25.502133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 394/778] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:25 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:25.849349 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:25.850578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:25.852961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:25.857763 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:25.858217 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:25.859013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:25.859530 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:25.992815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:26.001741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:26.003281 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:26.004436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d5412374-a696-42a1-b60f-43b6e40fa21a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1723 microversion: 2.20 time: 0.159146 May 27 03:41:26.004997 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 385/779] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:25 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:26.324529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97a2283e-2da8-475c-acb4-d39697e6dcde"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:26.325676 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:26.332566 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:26.336487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:26.336487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:26.336487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:26.410187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:26.513858 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-001d0e75-c44d-4317-8bdb-476a7d8c72f6 req-e6bfcc18-a07e-4783-9fc5-e36ad827926e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822", "name": "network-vif-deleted", "tag": "ca04734c-9ae1-421c-83aa-9ede7ab3af1a"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:26.530186 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-001d0e75-c44d-4317-8bdb-476a7d8c72f6 req-e6bfcc18-a07e-4783-9fc5-e36ad827926e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:26.530637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-001d0e75-c44d-4317-8bdb-476a7d8c72f6 req-e6bfcc18-a07e-4783-9fc5-e36ad827926e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:26.542797 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-001d0e75-c44d-4317-8bdb-476a7d8c72f6 req-e6bfcc18-a07e-4783-9fc5-e36ad827926e service nova] Creating event network-vif-deleted:ca04734c-9ae1-421c-83aa-9ede7ab3af1a for instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 on hv-cinder-82880 May 27 03:41:26.549162 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-001d0e75-c44d-4317-8bdb-476a7d8c72f6 req-e6bfcc18-a07e-4783-9fc5-e36ad827926e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039495 May 27 03:41:26.549920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 386/780] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:26.556953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:26.557711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:26.564326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:26.564775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:26.565539 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:26.565973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:26.632620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:26.638083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e2fc1fc4-b766-46b4-a717-6142f7d8de1a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1481 microversion: 2.1 time: 0.086010 May 27 03:41:26.638717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 387/781] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:26 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1481 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:27.022671 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:27.023322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:27.030247 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:27.030695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:27.031488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:27.031923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:27.036001 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:27.160661 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.169182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.170708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.171933 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e568bb73-e4ed-447a-8b01-ea9a0ac0fa3a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1723 microversion: 2.20 time: 0.153286 May 27 03:41:27.172499 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 388/782] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:27 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:27.230543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cc64e4bf-7809-4cfc-b81f-d1351fb65fb7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "POST /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909870 May 27 03:41:27.231218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 395/783] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:41:26 2022] POST /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:27.655454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:27.656062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:27.662552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:27.663587 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:27.664361 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:27.664778 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:27.727401 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.734819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-345b2f64-4c1a-476c-8323-06f34509f5a4 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1307 microversion: 2.1 time: 0.083274 May 27 03:41:27.735413 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 389/784] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:27 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:28.191856 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:28.192555 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:28.200940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:28.201397 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:28.202174 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:28.202612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:28.340109 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.348752 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.350824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.364953 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-312e46f3-f9b2-4751-ae01-4fa5a66626db tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1723 microversion: 2.20 time: 0.164968 May 27 03:41:28.364953 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 396/785] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:28 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:28.751668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:28.752276 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:28.759584 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:28.760081 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:28.760836 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:28.761266 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:28.793510 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:28.793951 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:28.794396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lazy-loading 'fault' on Instance uuid e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:41:28.835369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2671aaae84644acb89c3c3595bb5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b1335715234895a0c1a555b22ee8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.842770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0b01b941-b89a-4402-9159-1a5ffbda23d9 tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 200 len: 1312 microversion: 2.1 time: 0.095112 May 27 03:41:28.843353 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 390/786] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:28 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:29.376093 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:29.379216 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:29.383338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.383997 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.384791 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.385226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.515860 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:29.524390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:29.525917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:29.527151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-83933018-fe9e-403e-8c24-245f91e5e27d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1666 microversion: 2.20 time: 0.154951 May 27 03:41:29.527722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 397/787] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:29 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:29.544472 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcd30945-a7a8-4cb9-bfe6-207729971963"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:29.545574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:29.551603 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.552054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.552812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.553301 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.683129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-95537441-3279-472b-a74f-1a228fef446b req-4ddb4e12-1366-4bf9-86ed-2025253888e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "name": "network-vif-unplugged", "status": "completed", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:29.692797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-95537441-3279-472b-a74f-1a228fef446b req-4ddb4e12-1366-4bf9-86ed-2025253888e1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.693253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-95537441-3279-472b-a74f-1a228fef446b req-4ddb4e12-1366-4bf9-86ed-2025253888e1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.705790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.compute.server_external_events [req-95537441-3279-472b-a74f-1a228fef446b req-4ddb4e12-1366-4bf9-86ed-2025253888e1 service nova] Unable to find a host for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45. Dropping event network-vif-unplugged {{(pid=124770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 03:41:29.706685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-95537441-3279-472b-a74f-1a228fef446b req-4ddb4e12-1366-4bf9-86ed-2025253888e1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027732 May 27 03:41:29.707821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 398/788] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 03:41:29.859039 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:29.859659 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] [instance: e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:29.866385 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.866855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.867639 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:29.868079 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:29.882035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] HTTP exception thrown: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 could not be found. May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Request method failure captured: May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 HTTP/1.1 May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEdJle72uA52wRzl38Wo43jLfBUD8_6-W2I-TixspRM8trW4-_2haG8mfc5F9L3Xi5Bqj3rHIho7SA8IGXv5IHFoJA36ducSbafluUVIdz287TsaM13us68tDUJkPJf9fZzmKloTmtdMm-Skgg0llpRkAvVz2pqCiat4SA7MX--FAis May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:41:29.883771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_03b1335715234895a0c1a555b22ee8d3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/03b1335715234895a0c1a555b22ee8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/03b1335715234895a0c1a555b22ee8d3"}]}] May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 03b1335715234895a0c1a555b22ee8d3 May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349374577 May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: b2671aaae84644acb89c3c3595bb5673 May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349374577-project May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 could not be found. May 27 03:41:29.885219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822'} May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 could not be found. May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:29.886074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 could not be found. May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 could not be found. May 27 03:41:29.887498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:29.888852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] Returning 404 to user: Instance e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:29.888852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-73dfaed9-4fb6-4f94-b87e-d8312eedd80a tempest-ServerRescueNegativeTestJSON-1349374577 tempest-ServerRescueNegativeTestJSON-1349374577-project] 10.222.0.24 "GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822" status: 404 len: 111 microversion: 2.1 time: 0.030243 May 27 03:41:29.889302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 399/789] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:29 2022] GET /compute/v2.1/servers/e7aaae9a-624e-4ca1-a2d9-b3bbbe2db822 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:41:30.745786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0e499773-3619-432c-a2cb-6549674fce78 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.205015 May 27 03:41:30.752022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 391/790] 10.222.0.24 () {62 vars in 1363 bytes} [Fri May 27 03:41:29 2022] POST /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-volume_attachments => generated 188 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:41:30.873033 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:30.873554 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:30.875963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:30.880799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:30.881855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:30.882815 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:30.883278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:31.544337 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-adb7ab39-bd23-41a1-870e-1cdd2002bfeb tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-volume_attachments/fcd30945-a7a8-4cb9-bfe6-207729971963" status: 202 len: 0 microversion: 2.20 time: 0.675157 May 27 03:41:31.547885 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 400/791] 10.222.0.24 () {60 vars in 1456 bytes} [Fri May 27 03:41:30 2022] DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-volume_attachments/fcd30945-a7a8-4cb9-bfe6-207729971963 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:41:31.611178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:31.611665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:31.618511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:31.619007 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:31.619930 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:31.620367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:31.881764 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fbe25928-7dd3-4bca-bd3b-7896e843f343 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "POST /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/action" status: 202 len: 0 microversion: 2.20 time: 0.274240 May 27 03:41:31.883700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 392/792] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 27 03:41:31 2022] POST /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:41:31.892749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:31.894047 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:31.902054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:31.902577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:31.903299 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:31.908606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:32.132089 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:32.146221 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:32.149686 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:32.152148 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-24b57d95-d0c5-4805-8bed-f60631d0d550 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1674 microversion: 2.20 time: 0.264414 May 27 03:41:32.152843 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 401/793] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:31 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:33.170622 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:33.171327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:33.180063 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:33.180564 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:33.181432 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:33.181896 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:33.365832 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.376147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.377732 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.379024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8504e933-a54a-4223-8454-51729292d351 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1674 microversion: 2.20 time: 0.212946 May 27 03:41:33.379946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 393/794] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:33 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:34.397591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:34.398211 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:34.404807 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:34.405261 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:34.406040 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:34.406630 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:34.555275 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.563788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.565370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.573788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2fab0b29-cc75-49db-b38e-4f6ef0800fa4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.173002 May 27 03:41:34.573788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 402/795] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:34 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:35.586933 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:35.587531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:35.597701 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:35.598164 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:35.598953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:35.599395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:35.736720 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:35.746192 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:35.748070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:35.749515 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-66386b25-6436-4655-891c-dcdd3f3b983e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.167531 May 27 03:41:35.750073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 394/796] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:35 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:35.994336 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:35.995768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:36.002560 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:36.003055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:36.003828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:36.004266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:36.094298 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'services' on Instance uuid 3c468d59-f3a1-44de-8052-3b6b651ea73e {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:41:36.335114 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-08d4c60f-3ae1-40d9-b97e-ad1b4ffc7178 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments/97a2283e-2da8-475c-acb4-d39697e6dcde" status: 202 len: 0 microversion: 2.1 time: 0.344813 May 27 03:41:36.335949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 403/797] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:41:35 2022] DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments/97a2283e-2da8-475c-acb4-d39697e6dcde => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:41:36.345504 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:36.346792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:36.357100 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:36.362470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:36.362470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:36.362470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:36.429552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fbcb1110-e04c-41e4-87c3-96fd8c1f7757 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088290 May 27 03:41:36.436947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 395/798] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:36 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:36.769191 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:36.770035 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:36.784021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:36.784477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:36.785278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:36.785721 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:37.074149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.084866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.086611 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.087992 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ec03780d-631c-4ae6-ab1e-b465f460f45e tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.323405 May 27 03:41:37.094541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 404/799] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:36 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:37.448403 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:37.449329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:37.456228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:37.456673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:37.457712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:37.458317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:37.519780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f3beab86-cbf7-4b8f-8803-1bd77b3142e7 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075407 May 27 03:41:37.520327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 396/800] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:37 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:38.105840 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:38.106454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:38.124323 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:38.124880 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:38.125756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:38.126687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:38.290975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.301332 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.303026 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.304454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-71829f1f-a3a1-4b93-bbb2-1244f55d931a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.202770 May 27 03:41:38.305662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 405/801] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:38 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:38.536210 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:38.537848 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:38.544509 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:38.545270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:38.546285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:38.546960 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:38.580518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-92da21aa-b584-4412-8adc-9699140b62b6 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052452 May 27 03:41:38.581607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 397/802] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:38 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:39.333094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:39.342631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:39.351582 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:39.353147 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:39.356913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:39.357683 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:39.592449 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:39.593658 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:39.594745 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:39.605936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:39.606870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:39.607333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:39.607851 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:39.608121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:39.608562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:39.609252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0577b035-2da6-4258-881b-b6435ecf587b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.290120 May 27 03:41:39.615288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 406/803] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:39 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:39.645168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0746dd4c-bb3d-458b-afce-26a0c1966258 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055905 May 27 03:41:39.646365 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 398/804] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:39 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:40.630100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:40.630100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:40.637001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:40.643435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:40.646550 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:40.647065 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:40.658044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:40.659075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:40.673688 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:40.675579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:40.676716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:40.677314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:40.758069 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d593b6f5-489b-4e9d-9813-8e320b24ffd5 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102863 May 27 03:41:40.761552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 399/805] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:40 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:41:40.942647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.961098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.961098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.961098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-36cb8ed6-c50e-40ce-baa3-732d7a4a9af8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.335159 May 27 03:41:40.974357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 407/806] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:40 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:41.775247 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:41.776386 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:41.785940 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:41.802243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:41.803186 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:41.803674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:41.853108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:41.868606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d9040e44-63d6-435f-9c6a-60993e531308 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099631 May 27 03:41:41.873026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 400/807] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:41 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:41.981798 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:41.983057 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:41.997267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:41.998741 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:42.000056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:42.002760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:42.278881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.291827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.296705 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.298679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8986fb9d-eeda-450d-9dad-9b509eab848f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.320968 May 27 03:41:42.303541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 408/808] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:41 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:42.879801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:42.880762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:42.915366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:42.938412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:42.939284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:42.939719 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:43.015591 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b0804b55-2bd2-4bcf-ada6-c36c1018f333 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139777 May 27 03:41:43.016176 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 401/809] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:42 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:43.294531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b6561123-e441-4362-bb5b-6d670168d4ba tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: .version_select at 0x7f30465104c0>, body: {"keypair": {"name": "tempest-keypair-1127119134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuHr9jn5BdJhM71PoVsY2gqrE4Llfee8E13e9koosREQsompjbavRZRBhz22un+5kOaHZwYiG3Rk60jgZwdjN/I9oAPn+Gzr6Z/lmNMjJTr01GTRagYWKYsfCBwv9FzTA=="}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:43.321683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:43.322293 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:43.328694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:43.329138 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:43.329897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:43.330322 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:43.331145 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b6561123-e441-4362-bb5b-6d670168d4ba tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:41:43.337916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-b6561123-e441-4362-bb5b-6d670168d4ba tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for user 2e4436dc550a44269ffbd4760670f551 and project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'key_pairs'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:41:43.467296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b6561123-e441-4362-bb5b-6d670168d4ba tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.310376 May 27 03:41:43.468004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 409/810] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:41:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:41:43.503892 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.513636 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.515342 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.516624 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7b83ace4-254c-4262-bd64-9f48c0d62492 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.199236 May 27 03:41:43.517258 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 402/811] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:43 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:44.028654 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:44.029702 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:44.038532 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:44.039311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:44.040291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:44.040895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:44.056207 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:44.073615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-37a62126-e55f-463c-8a9b-f6678fdb2a1a tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049543 May 27 03:41:44.074727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 410/812] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:44 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:44.535126 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:44.535742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:44.545684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:44.546140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:44.549402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:44.549402 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:44.770290 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:44.785504 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:44.787694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:44.789487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-48885a2f-7f76-414a-9f2f-9eb70558b682 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.258310 May 27 03:41:44.791016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 403/813] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:44 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:45.085828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:45.086778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:45.093769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:45.097860 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:45.097860 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:45.097860 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:45.134165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-92277b99-8588-4cb9-9567-22dec11b41e1 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052800 May 27 03:41:45.138791 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 411/814] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:45 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:45.809326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:45.809925 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:45.818120 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:45.822575 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:45.822575 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:45.822575 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:45.994012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.012098 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.019783 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.022296 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3375ec4f-93bb-43e7-bf90-dd655b206921 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.216532 May 27 03:41:46.031780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 404/815] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:45 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:46.152122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:46.153744 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:46.160771 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:46.161224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:46.162202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:46.162644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:46.196248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f0cd2d63-0d12-4529-b3cb-12ea2a5a1e63 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053590 May 27 03:41:46.197304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 412/816] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:46 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:46.771392 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-292024664", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d90c714-9bd8-40b9-8a54-714767000c3f"}], "security_groups": [{"name": "tempest-securitygroup--1196189375"}], "key_name": "tempest-keypair-1127119134", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:46.887885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] validate_networks() for [('9d90c714-9bd8-40b9-8a54-714767000c3f', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:41:47.044136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.045196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:47.057208 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.060069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.060963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.061581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.319529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.328857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.330403 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.332141 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b7c1fd00-c234-4195-8d47-915133f7b19d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.294640 May 27 03:41:47.342993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 413/817] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:47 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:47.346757 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.347801 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:47.351329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:41:47.351818 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:41:47.352411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:41:47.352950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:41:47.353358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:41:47.354538 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.355080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.355878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.356282 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.362347 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.362897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.363756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.364272 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.381078 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:41:47.384917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for user 2e4436dc550a44269ffbd4760670f551 and project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:41:47.385140 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dd378ce3-2c60-40e2-a4fc-277a56ccd46b tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051505 May 27 03:41:47.385888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 414/818] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:41:47 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:41:47.395841 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:41:47.398656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:41:47.442953 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.443495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:47.449679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.450156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.450934 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.451371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.477605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:41:47.542463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f3b239cf-f0c2-4204-b885-9e72ddcee2a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.775426 May 27 03:41:47.543142 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 405/819] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:41:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:41:47.552771 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-678f473b-a6e9-4b53-a8c2-381aa8bb40c8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.553378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-678f473b-a6e9-4b53-a8c2-381aa8bb40c8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:47.609170 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-678f473b-a6e9-4b53-a8c2-381aa8bb40c8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.616177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-678f473b-a6e9-4b53-a8c2-381aa8bb40c8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1237 microversion: 2.1 time: 0.067008 May 27 03:41:47.616741 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 406/820] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:47 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:47.975529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5c7325ec-fd85-4cb3-ad5f-aeae31dd45dc tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 204 len: 0 microversion: 2.1 time: 0.535338 May 27 03:41:47.976528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 415/821] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:47 2022] DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:41:47.986243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.986928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:47.993321 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.994443 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:47.995433 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:47.995877 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:48.127815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:48.135620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-88151ea9-3998-46ba-a6a9-e384c70e3221 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1681 microversion: 2.1 time: 0.153677 May 27 03:41:48.136232 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 407/822] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:47 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:48.351507 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:48.352375 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:48.359034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:48.359669 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:48.360379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:48.360815 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:48.488895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:48.497916 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:48.499565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:48.500743 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-54814687-af4c-4935-ae0e-c50bbd929893 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.154193 May 27 03:41:48.508429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 416/823] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:48 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:48.633177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c733901d-0890-4210-b2ce-878802c843fe tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:48.633700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c733901d-0890-4210-b2ce-878802c843fe tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:48.685264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c733901d-0890-4210-b2ce-878802c843fe tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:48.692047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c733901d-0890-4210-b2ce-878802c843fe tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1237 microversion: 2.1 time: 0.062926 May 27 03:41:48.692624 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 408/824] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:48 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:49.153046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:49.153678 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:49.159750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.160199 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.160958 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.161409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.291222 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.298972 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ab5cc9ea-3463-4da4-ab29-aca9b340cc2f tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1681 microversion: 2.1 time: 0.149764 May 27 03:41:49.299614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 417/825] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:49 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:49.519123 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:49.519709 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:49.527588 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.528067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.528841 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.529277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.657778 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.667183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.668723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.670121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f9219689-f17b-4bb5-99d9-091efd7b6717 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.155112 May 27 03:41:49.670633 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 409/826] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:49 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:49.710145 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:49.715203 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:49.731729 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.732338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.733240 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.733796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.797320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.805419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7fcbc97b-bc9a-4a9b-ab36-c0d0f33348e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1233 microversion: 2.1 time: 0.099974 May 27 03:41:49.806111 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 418/827] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:49 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1233 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:49.837955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-4e9249b0-5f9e-435a-8436-e1f8679b2437 req-53ef9133-25cd-402d-91a9-00c6744e6945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "name": "network-vif-plugged", "status": "completed", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:49.846353 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4e9249b0-5f9e-435a-8436-e1f8679b2437 req-53ef9133-25cd-402d-91a9-00c6744e6945 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:49.846810 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4e9249b0-5f9e-435a-8436-e1f8679b2437 req-53ef9133-25cd-402d-91a9-00c6744e6945 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:49.858243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-4e9249b0-5f9e-435a-8436-e1f8679b2437 req-53ef9133-25cd-402d-91a9-00c6744e6945 service nova] Creating event network-vif-plugged:ee7bf9c2-a2d0-4695-960b-55515919a177 for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 on hv-cinder-82880 May 27 03:41:49.865512 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-4e9249b0-5f9e-435a-8436-e1f8679b2437 req-53ef9133-25cd-402d-91a9-00c6744e6945 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 May 27 03:41:49.867038 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 410/828] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:50.316285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.316901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:50.323526 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:50.323973 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:50.324733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:50.325169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:50.472698 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.481331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2af9d8f1-b197-4254-b46e-e9136f7da124 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1681 microversion: 2.1 time: 0.168859 May 27 03:41:50.515925 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 419/829] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:50 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:50.689814 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.690495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:50.697751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:50.698212 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:50.699022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:50.699460 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:50.823196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.823812 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:50.830747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:50.831226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:50.831998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:50.832816 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:50.848692 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.857726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.859276 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.860463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1b897749-f276-4d92-984e-1791e3fcacc8 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.175431 May 27 03:41:50.861027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 411/830] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:50 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:50.902960 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.911303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2570c9e6-8cab-4900-b522-67e25f3386bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1289 microversion: 2.1 time: 0.092427 May 27 03:41:50.911937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 420/831] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:50 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:51.390495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-3719861f-0767-491e-858a-e69138e8b45b req-aa7aded9-cba9-4c17-b3b2-e031dc72a853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c468d59-f3a1-44de-8052-3b6b651ea73e", "name": "network-vif-deleted", "tag": "7de6ae85-3bb0-4331-96a8-95d107a33391"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:51.404437 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-3719861f-0767-491e-858a-e69138e8b45b req-aa7aded9-cba9-4c17-b3b2-e031dc72a853 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.407652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-3719861f-0767-491e-858a-e69138e8b45b req-aa7aded9-cba9-4c17-b3b2-e031dc72a853 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:51.420946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-3719861f-0767-491e-858a-e69138e8b45b req-aa7aded9-cba9-4c17-b3b2-e031dc72a853 service nova] Creating event network-vif-deleted:7de6ae85-3bb0-4331-96a8-95d107a33391 for instance 3c468d59-f3a1-44de-8052-3b6b651ea73e on hv-cinder-82880 May 27 03:41:51.427276 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-3719861f-0767-491e-858a-e69138e8b45b req-aa7aded9-cba9-4c17-b3b2-e031dc72a853 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040284 May 27 03:41:51.430381 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 412/832] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:51.499166 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:51.499782 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:51.506521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.507077 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:51.507856 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.508290 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:51.586331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:51.597237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0096664a-2148-4eea-93c1-4852fbef7594 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1613 microversion: 2.1 time: 0.101851 May 27 03:41:51.597839 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 421/833] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:51 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:51.883305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:51.884004 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:51.890913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.891623 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:51.892383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.892813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:51.928987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:51.929784 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:51.944380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.951599 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:51.951599 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:51.951599 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:52.027063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.034762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5752ad67-6925-415e-9f2d-b2ec6bed3e4f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1297 microversion: 2.1 time: 0.110332 May 27 03:41:52.035371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 422/834] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:51 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:52.057302 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.065902 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.067459 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.069238 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4849d0f4-c6af-4ec7-b83c-c1b02254294f tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.190218 May 27 03:41:52.079894 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 413/835] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:51 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:52.615605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:52.621609 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:52.628122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:52.628897 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:52.632616 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:52.634386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:52.670626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:52.671320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:52.671774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lazy-loading 'fault' on Instance uuid 3c468d59-f3a1-44de-8052-3b6b651ea73e {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:41:52.727189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac1130950b8457ea3a9349346437357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1382d8f774b5db702d78e3bed622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.735441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-46c36381-0ea5-4f59-bc70-d1c7f5b72693 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 200 len: 1330 microversion: 2.1 time: 0.124433 May 27 03:41:52.740893 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 423/836] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:52 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:53.053975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.053975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:53.071026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.071493 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.072277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.072719 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.090001 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.090620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:53.100941 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.101824 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.103071 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.103954 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.307117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.307908 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.319720 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-71fd64d4-5e77-464e-9209-70610515687b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.271310 May 27 03:41:53.320609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 414/837] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:53 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:53.335633 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.341688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.341688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1678eba8-bfe2-496d-8305-b8e4d3b61b07 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1732 microversion: 2.20 time: 0.253658 May 27 03:41:53.341688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 424/838] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:53 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:53.757212 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.757821 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:53.765251 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.765698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.766994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.772309 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.785303 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e HTTP/1.1 May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:53.787067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:53.788887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '3c468d59-f3a1-44de-8052-3b6b651ea73e'} May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:53.789742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:53.795488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:53.797241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:53.797241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f3942ca1-0ff6-48e4-9846-f804b88fd334 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 404 len: 111 microversion: 2.1 time: 0.035918 May 27 03:41:53.797241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 415/839] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:53 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:53.797931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6f226027-fa9a-4343-93e3-5b1b81b3fad3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '.version_select at 0x7f3046510040>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.801337 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=4 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:53.885273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6f226027-fa9a-4343-93e3-5b1b81b3fad3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910603045" status: 202 len: 0 microversion: 2.1 time: 0.091306 May 27 03:41:53.885940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 425/840] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 27 03:41:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910603045 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:41:53.928986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-857fcde7-e5f6-4721-8518-dab1b1b6fd99 req-f3b8525a-9c40-4d3a-96e7-3dea10bdf78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a65177-fd0d-4c44-a70a-d285315c23ee", "tag": "0c05523a-7a76-4594-a966-ad04b22c87e0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:53.941484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-857fcde7-e5f6-4721-8518-dab1b1b6fd99 req-f3b8525a-9c40-4d3a-96e7-3dea10bdf78b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:53.949629 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-857fcde7-e5f6-4721-8518-dab1b1b6fd99 req-f3b8525a-9c40-4d3a-96e7-3dea10bdf78b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:53.958990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-857fcde7-e5f6-4721-8518-dab1b1b6fd99 req-f3b8525a-9c40-4d3a-96e7-3dea10bdf78b service nova] Creating event network-changed:0c05523a-7a76-4594-a966-ad04b22c87e0 for instance 87a65177-fd0d-4c44-a70a-d285315c23ee on hv-cinder-82880 May 27 03:41:53.967710 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-857fcde7-e5f6-4721-8518-dab1b1b6fd99 req-f3b8525a-9c40-4d3a-96e7-3dea10bdf78b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043525 May 27 03:41:53.968522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 416/841] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:54.338273 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:54.339023 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:54.345768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:54.346292 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:54.347169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:54.347696 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:54.353411 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:54.360427 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:54.361479 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:54.369822 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:54.370374 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:54.371699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:54.372155 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:54.532605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.541075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-859cb2ed-4227-4ad9-8b11-63e73abffcb8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.208050 May 27 03:41:54.541977 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 426/842] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:54 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:54.562753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.570804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.572357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.573602 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-92d0c6e6-b588-426c-826b-7880c6eb530b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1719 microversion: 2.20 time: 0.218273 May 27 03:41:54.574160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 417/843] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:41:54 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:55.557854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:55.558502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:55.565064 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:55.565568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:55.566335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:55.566774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:55.693804 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:55.701532 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9e081e27-995a-40f5-8ccf-77aa3a600e8d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.147632 May 27 03:41:55.702108 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 427/844] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:55 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:56.479966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:56.480466 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:56.487034 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:56.487483 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:56.488241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:56.488678 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:56.501684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e HTTP/1.1 May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:56.503344 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.504642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '3c468d59-f3a1-44de-8052-3b6b651ea73e'} May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:56.505856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.507913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:56.511452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:56.511452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-89735610-e3ab-4c93-82b9-4bb46fd26716 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 404 len: 111 microversion: 2.1 time: 0.028600 May 27 03:41:56.511452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 418/845] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:56 2022] DELETE /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:56.513541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:56.514159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 3c468d59-f3a1-44de-8052-3b6b651ea73e] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:56.520186 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:56.520638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:56.522021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:56.522456 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:56.535728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e HTTP/1.1 May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:41:56.537354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.538917 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '3c468d59-f3a1-44de-8052-3b6b651ea73e'} May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:56.539728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. May 27 03:41:56.541181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:56.542436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 3c468d59-f3a1-44de-8052-3b6b651ea73e could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:56.542436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f951324f-9659-47e1-a354-e95c4e517bcb tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e" status: 404 len: 111 microversion: 2.1 time: 0.029014 May 27 03:41:56.542436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 428/846] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:56 2022] GET /compute/v2.1/servers/3c468d59-f3a1-44de-8052-3b6b651ea73e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:56.719223 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:56.719778 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:56.726264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:56.726706 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:56.727475 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:56.727901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:56.854245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:56.861642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f81eed0a-6716-4124-b209-2a44c958f2aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.146428 May 27 03:41:56.862389 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 419/847] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:56 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:57.819116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.819640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:57.826042 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.826494 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.827288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.827728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.841576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b HTTP/1.1 May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:41:57.843193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.844543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '354bc006-0821-4eda-8ff5-304b82dad03b'} May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:57.845279 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.846427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:57.847603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:57.847603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d7dabf1e-050d-48b3-95fd-9fb9b43f38da tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 404 len: 111 microversion: 2.1 time: 0.029931 May 27 03:41:57.847603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 429/848] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:57 2022] DELETE /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:57.853237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.853846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 354bc006-0821-4eda-8ff5-304b82dad03b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:57.855902 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:57.857127 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:57.861998 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.862457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.865828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.865828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.878700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.879931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b HTTP/1.1 May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:57.880286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.882151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '354bc006-0821-4eda-8ff5-304b82dad03b'} May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:57.883807 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. May 27 03:41:57.885039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.887728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:57.887885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 354bc006-0821-4eda-8ff5-304b82dad03b could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:57.887885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4a93d5b5-e36c-46b4-9d57-562b45fd08e3 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b" status: 404 len: 111 microversion: 2.1 time: 0.032945 May 27 03:41:57.887885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 420/849] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:57 2022] GET /compute/v2.1/servers/354bc006-0821-4eda-8ff5-304b82dad03b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:57.888335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.888499 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.889919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.889919 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.891048 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.891585 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:57.904412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.904412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.904412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.904412 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.914284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 HTTP/1.1 May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:57.915923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.917429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': 'cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1'} May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:57.918280 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.919786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.921265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:57.921265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a91a9281-0efb-4cad-975c-c43254eb425d tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 404 len: 111 microversion: 2.1 time: 0.032079 May 27 03:41:57.921265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 421/850] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:57 2022] DELETE /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:41:57.929519 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.930139 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:57.936044 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.938825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.938825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:57.938825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:57.952081 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 HTTP/1.1 May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:57.953644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.955175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': 'cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1'} May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:57.955944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. May 27 03:41:57.957211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:57.958699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:57.958699 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8f0061a3-af80-4100-b2e7-44b707cb3584 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1" status: 404 len: 111 microversion: 2.1 time: 0.029900 May 27 03:41:57.959151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 422/851] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:57 2022] GET /compute/v2.1/servers/cdde11d5-7fcb-4f1e-b691-2b9f029bd6e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:41:58.028302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:58.036158 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8d3e97ee-1a44-48fe-bcf9-52f17e8c9438 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.160282 May 27 03:41:58.037263 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 430/852] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:57 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:59.057467 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:59.058053 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:59.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=10 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:59.065664 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.066141 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.066921 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.067394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.195976 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:59.203506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-639ed5a4-9d5e-4eb6-9d91-089af38132b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.150003 May 27 03:41:59.204063 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 423/853] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:59 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:59.261297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:59.261793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:59.268382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.268866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.269634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.270077 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.283895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b HTTP/1.1 May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:41:59.285433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.287514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '79319ab8-3b21-4189-af20-8295ec40a10b'} May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:59.288396 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.289799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:41:59.291479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:59.291479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-456f55d4-a608-42f3-844d-f5af1c8d4093 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 404 len: 111 microversion: 2.1 time: 0.029442 May 27 03:41:59.291479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 431/854] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:41:59 2022] DELETE /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:59.295755 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:59.296365 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] [instance: 79319ab8-3b21-4189-af20-8295ec40a10b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:41:59.302325 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.302792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.303595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.304025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.317183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] HTTP exception thrown: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Request method failure captured: May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b HTTP/1.1 May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb2vkgKwHa1oAfKFYv1dYogNqv7X27_BgWg88tFobqt5fo9mqHdxbSw8x62agBfZG4GK8EfyZH2_r8VMkfYCD_Ty6r2dRbw5b4CZ7MT2dtHsj50gwAQhDaM9hQS7myReWB1-s-EEcwY96ViH66E7f4DuthfcX4SaKH8rEyWyVbboxs May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:41:59.318609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8ae1382d8f774b5db702d78e3bed622a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8ae1382d8f774b5db702d78e3bed622a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8ae1382d8f774b5db702d78e3bed622a"}]}] May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 8ae1382d8f774b5db702d78e3bed622a May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1822918604 May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: dac1130950b8457ea3a9349346437357 May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1822918604-project May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.320175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '79319ab8-3b21-4189-af20-8295ec40a10b'} May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:41:59.324319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. May 27 03:41:59.326241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:41:59.327653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] Returning 404 to user: Instance 79319ab8-3b21-4189-af20-8295ec40a10b could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:41:59.327653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ea1cbbbd-da5d-4cca-a1ba-011f71014f30 tempest-AttachVolumeNegativeTest-1822918604 tempest-AttachVolumeNegativeTest-1822918604-project] 10.222.0.24 "GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b" status: 404 len: 111 microversion: 2.1 time: 0.028095 May 27 03:41:59.327653 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 424/855] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:41:59 2022] GET /compute/v2.1/servers/79319ab8-3b21-4189-af20-8295ec40a10b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:59.972019 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-3edcf04b-85c8-4118-a229-ea1201449c0f req-5ab80a46-a790-4159-b2bd-4e84935f459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a65177-fd0d-4c44-a70a-d285315c23ee", "name": "network-vif-plugged", "status": "completed", "tag": "0c05523a-7a76-4594-a966-ad04b22c87e0"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:59.981207 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-3edcf04b-85c8-4118-a229-ea1201449c0f req-5ab80a46-a790-4159-b2bd-4e84935f459a service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:41:59.981650 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-3edcf04b-85c8-4118-a229-ea1201449c0f req-5ab80a46-a790-4159-b2bd-4e84935f459a service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:41:59.995797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-3edcf04b-85c8-4118-a229-ea1201449c0f req-5ab80a46-a790-4159-b2bd-4e84935f459a service nova] Creating event network-vif-plugged:0c05523a-7a76-4594-a966-ad04b22c87e0 for instance 87a65177-fd0d-4c44-a70a-d285315c23ee on hv-cinder-82880 May 27 03:42:00.000971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-3edcf04b-85c8-4118-a229-ea1201449c0f req-5ab80a46-a790-4159-b2bd-4e84935f459a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 May 27 03:42:00.001830 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 432/856] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:42:00.221128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:00.221676 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:00.229105 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:00.229558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:00.230327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:00.230815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:00.377813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:00.386464 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dea2eb40-540c-4b4d-91e5-cec0ff8f8350 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.169261 May 27 03:42:00.387140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 425/857] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:00 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:01.405338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:01.406036 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:01.407998 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:01.413205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:01.413867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:01.414910 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:01.415513 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:01.556133 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:01.565292 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-94e9279d-2595-4404-b144-c48d8799261e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1363 microversion: 2.1 time: 0.165072 May 27 03:42:01.574008 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 433/858] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:01 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:02.581612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:02.584122 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:02.591751 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:02.592799 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:02.594067 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:02.595143 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:02.600567 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:02.773684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:02.782111 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-017e4347-4030-478c-ab82-33ced00e9601 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1548 microversion: 2.1 time: 0.204126 May 27 03:42:02.783238 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 426/859] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:02 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:02.800682 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:02.801552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:02.808956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:02.810652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:02.810652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:02.810652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:02.892671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8ea3e7db-53e2-444e-8c0b-c9392f08b0d9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096254 May 27 03:42:02.893341 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 434/860] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:42:02 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:03.953872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-270f9399-a9ce-455f-918a-291246e52056 req-484f1b2e-b797-464f-9a0d-43814e8131b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a65177-fd0d-4c44-a70a-d285315c23ee", "tag": "0c05523a-7a76-4594-a966-ad04b22c87e0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:03.963853 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-270f9399-a9ce-455f-918a-291246e52056 req-484f1b2e-b797-464f-9a0d-43814e8131b7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:03.964588 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-270f9399-a9ce-455f-918a-291246e52056 req-484f1b2e-b797-464f-9a0d-43814e8131b7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:03.977360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-270f9399-a9ce-455f-918a-291246e52056 req-484f1b2e-b797-464f-9a0d-43814e8131b7 service nova] Creating event network-changed:0c05523a-7a76-4594-a966-ad04b22c87e0 for instance 87a65177-fd0d-4c44-a70a-d285315c23ee on hv-cinder-82880 May 27 03:42:03.982548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-270f9399-a9ce-455f-918a-291246e52056 req-484f1b2e-b797-464f-9a0d-43814e8131b7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032352 May 27 03:42:03.983627 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 427/861] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:17.648003 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:17.649444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=35 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:17.651298 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=15 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:17.655206 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:17.655334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:17.655334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:17.656589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-c64035d5-7015-4581-a9fc-af34f8d54123 req-30443796-e714-457e-8062-c1afc440ffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:17.660993 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:17.661615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:17.662375 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:17.662933 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:17.664736 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c64035d5-7015-4581-a9fc-af34f8d54123 req-30443796-e714-457e-8062-c1afc440ffb5 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:17.665185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c64035d5-7015-4581-a9fc-af34f8d54123 req-30443796-e714-457e-8062-c1afc440ffb5 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:17.676337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-c64035d5-7015-4581-a9fc-af34f8d54123 req-30443796-e714-457e-8062-c1afc440ffb5 service nova] Creating event network-changed:0aa36f0b-ffa2-488e-b031-21fe9c191622 for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 on hv-cinder-82880 May 27 03:42:17.681543 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-c64035d5-7015-4581-a9fc-af34f8d54123 req-30443796-e714-457e-8062-c1afc440ffb5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031962 May 27 03:42:17.688945 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 428/862] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:17.690208 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:42:18.103108 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e299616f-940a-45fc-9ca5-a741545aef58 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 204 len: 0 microversion: 2.1 time: 0.456324 May 27 03:42:18.104433 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 435/863] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:42:17 2022] DELETE /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:42:18.113255 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:18.114310 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:18.124051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:18.124924 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:18.126101 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:18.126754 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:18.270173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:18.278913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-27e7665b-ac7b-4ee1-9580-26c8bf3836da tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.169918 May 27 03:42:18.291570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 429/864] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:18 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:19.298256 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:19.298996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:19.306121 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:19.306562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:19.307363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:19.307793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:19.693568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:19.701192 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e6536fe5-16ca-4a60-94b5-60bc5e20a63a tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1568 microversion: 2.1 time: 0.407387 May 27 03:42:19.701760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 436/865] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:19 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1568 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:20.500293 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-74db93bf-495f-4dd2-8a3c-5891f91bf0b9 req-bdb6b128-4eeb-4f75-8026-98d86fffc2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82dd530-bdcd-408b-9b6a-d6cde26fb9b6", "name": "network-vif-deleted", "tag": "0aa36f0b-ffa2-488e-b031-21fe9c191622"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:20.508756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-74db93bf-495f-4dd2-8a3c-5891f91bf0b9 req-bdb6b128-4eeb-4f75-8026-98d86fffc2b3 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:20.510945 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-74db93bf-495f-4dd2-8a3c-5891f91bf0b9 req-bdb6b128-4eeb-4f75-8026-98d86fffc2b3 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:20.520259 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-74db93bf-495f-4dd2-8a3c-5891f91bf0b9 req-bdb6b128-4eeb-4f75-8026-98d86fffc2b3 service nova] Creating event network-vif-deleted:0aa36f0b-ffa2-488e-b031-21fe9c191622 for instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 on hv-cinder-82880 May 27 03:42:20.525054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-74db93bf-495f-4dd2-8a3c-5891f91bf0b9 req-bdb6b128-4eeb-4f75-8026-98d86fffc2b3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028458 May 27 03:42:20.525649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 430/866] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:20.723049 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:20.724647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:20.732165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:20.732614 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:20.734015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:20.735830 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:20.803853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:20.812052 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2d304b1c-b0b9-4cdb-a35f-16aabe0e4cf8 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1219 microversion: 2.1 time: 0.096182 May 27 03:42:20.812586 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 437/867] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:20 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:21.830664 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:21.831379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:21.838273 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:21.838718 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:21.839529 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:21.839956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:21.870434 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:21.870926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:21.871378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lazy-loading 'fault' on Instance uuid d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:42:21.911598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001a4b10d544226b3b1453b06883db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19592ab2e5e04d7c952aebf73f4fca6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:21.919865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-40527f83-25e7-489d-8983-ef93a74b1383 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 200 len: 1224 microversion: 2.1 time: 0.093992 May 27 03:42:21.920481 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 431/868] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:21 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:22.936845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:22.937451 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] [instance: d82dd530-bdcd-408b-9b6a-d6cde26fb9b6] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:22.944002 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:22.944447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:22.945199 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:22.945629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:22.959329 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] HTTP exception thrown: Instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 could not be found. May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Request method failure captured: May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 HTTP/1.1 May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEdW4UGDPR_cjNVoGCtawpSDUL131wimiMGQub1HrcIt6s9byE2dKo55lC0xxj4mNEueWvUdYtkh0l-OM9HhtgKU7RiPa0G3XTfnUlYW5Ho30kaUg-2EdPT_qOUYfb5F4fP5ioLQmQfcHHu8nhAN4lIFIVkesp1_Hwrp94CBpiDzyRo May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 19592ab2e5e04d7c952aebf73f4fca6e May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestShelveInstance-894870543 May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:42:22.960927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_19592ab2e5e04d7c952aebf73f4fca6e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/19592ab2e5e04d7c952aebf73f4fca6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/19592ab2e5e04d7c952aebf73f4fca6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/19592ab2e5e04d7c952aebf73f4fca6e"}]}] May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestShelveInstance-894870543 May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 19592ab2e5e04d7c952aebf73f4fca6e May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestShelveInstance-894870543 May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-TestShelveInstance-894870543-project May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 9001a4b10d544226b3b1453b06883db4 May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestShelveInstance-894870543-project May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 could not be found. May 27 03:42:22.962473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'd82dd530-bdcd-408b-9b6a-d6cde26fb9b6'} May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 could not be found. May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:22.963466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 could not be found. May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 could not be found. May 27 03:42:22.964943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:22.966266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Returning 404 to user: Instance d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:22.966266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cef61060-2c3e-4cad-881c-b2178f2104b3 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6" status: 404 len: 111 microversion: 2.1 time: 0.029374 May 27 03:42:22.966266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 438/869] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:22 2022] GET /compute/v2.1/servers/d82dd530-bdcd-408b-9b6a-d6cde26fb9b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:23.213260 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5439c318-05ff-4233-8109-a7e5f7a5db48 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] Calling method '.version_select at 0x7f30468acaf0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:23.346134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5439c318-05ff-4233-8109-a7e5f7a5db48 tempest-TestShelveInstance-894870543 tempest-TestShelveInstance-894870543-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2016079672" status: 202 len: 0 microversion: 2.1 time: 0.137171 May 27 03:42:23.346719 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 432/870] 10.222.0.24 () {58 vars in 1253 bytes} [Fri May 27 03:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2016079672 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:26.417467 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:26.418543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:26.427838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:26.430449 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:26.431427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:26.432424 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:26.485361 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f3ad0fce-79b3-4407-ad31-27fd712127fa tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077200 May 27 03:42:26.489266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 439/871] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 27 03:42:26 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:26.592880 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:26.595156 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:26.609961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:26.609961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:26.611290 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:26.612516 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:26.642538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:42:27.028439 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dd9e47e5-c543-42e2-9694-6c58d01b70be tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 204 len: 0 microversion: 2.20 time: 0.452927 May 27 03:42:27.028439 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 433/872] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 27 03:42:26 2022] DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:42:27.035808 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:27.036535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:27.044055 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:27.045886 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:27.046973 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:27.047623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:27.213003 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:27.225150 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:27.226709 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:27.228182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dc3f72f2-958c-4c2e-a23a-c37d9d32149a tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.196789 May 27 03:42:27.228755 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 440/873] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:27 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:42:28.247212 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:28.247976 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:28.254508 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:28.254993 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:28.255780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:28.256214 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:28.433762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:28.444174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:28.446394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:28.448027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c056ec2b-0ab2-4bdf-a569-228d3d12845c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1725 microversion: 2.20 time: 0.205263 May 27 03:42:28.448949 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 434/874] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:28 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:42:29.468107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:29.469262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:29.483275 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:29.483725 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:29.484688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:29.487335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:29.590122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:29.605601 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:29.607136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:29.608309 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bf68f845-5ed4-46a7-bf27-6f7d150005d4 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1657 microversion: 2.20 time: 0.144065 May 27 03:42:29.631201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 441/875] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:29 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1657 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:42:29.816261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-4016522e-81df-4d04-beb0-ca2c7501480e req-089b5323-32ab-487c-a395-371aa49cb2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9baead13-4dfc-47d4-a5d3-5a0a4b760f45", "name": "network-vif-deleted", "tag": "ee7bf9c2-a2d0-4695-960b-55515919a177"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:29.832729 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4016522e-81df-4d04-beb0-ca2c7501480e req-089b5323-32ab-487c-a395-371aa49cb2f1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:29.835154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4016522e-81df-4d04-beb0-ca2c7501480e req-089b5323-32ab-487c-a395-371aa49cb2f1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:29.860867 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-4016522e-81df-4d04-beb0-ca2c7501480e req-089b5323-32ab-487c-a395-371aa49cb2f1 service nova] Creating event network-vif-deleted:ee7bf9c2-a2d0-4695-960b-55515919a177 for instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 on hv-cinder-82880 May 27 03:42:29.867567 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-4016522e-81df-4d04-beb0-ca2c7501480e req-089b5323-32ab-487c-a395-371aa49cb2f1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055007 May 27 03:42:29.868621 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 435/876] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:30.626014 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:30.626873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:30.641818 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:30.642792 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:30.643695 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:30.644284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:30.691716 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:30.694783 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:30.695358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lazy-loading 'fault' on Instance uuid 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:42:30.748233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:30.785673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:30.787339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '104a135932a144269f1f2aa7359098ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377b9e588bd44f3b29b03728c418151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:30.788556 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-449a7bcd-d27d-4f80-8cb3-a6d73965d14c tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 200 len: 1372 microversion: 2.20 time: 0.166984 May 27 03:42:30.789443 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 442/877] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:30 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:42:31.811624 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:31.812310 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:31.819465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:31.819841 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:31.820909 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:31.821369 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:31.836125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] HTTP exception thrown: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Request method failure captured: May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 HTTP/1.1 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb1UkdQRkv3TQQ8OhP0E7bfOnGgxdCSJQ15KnSFlFfIeqY0XxQ3462PdJdTQ8d1PbZVIpvZDx_9oJKwb2E02-c1T9JxhN9AZI32BZCESPDlRfjw9DzwdpRVGJcALRVI2Y_Lki--VgdmohYUZHgNK93fbgOl7mtbCt-pjTgsvI1Yv9U May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:42:31.837812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1377b9e588bd44f3b29b03728c418151", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1377b9e588bd44f3b29b03728c418151"}]}] May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 104a135932a144269f1f2aa7359098ed May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:31.839511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '9baead13-4dfc-47d4-a5d3-5a0a4b760f45'} May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:31.840379 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:31.841885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:31.843186 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Returning 404 to user: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:31.843186 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0953b5d1-5bc3-436f-8b9b-18bcf4a7199d tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 404 len: 111 microversion: 2.20 time: 0.032514 May 27 03:42:31.843186 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 436/878] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:31 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:42:31.851740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4cf46468-37a5-4578-b51a-1603e5eb0834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '.version_select at 0x7f3046510b80>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:31.947910 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4cf46468-37a5-4578-b51a-1603e5eb0834 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058245803" status: 204 len: 0 microversion: 2.20 time: 0.100027 May 27 03:42:31.948542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 443/879] 10.222.0.24 () {60 vars in 1261 bytes} [Fri May 27 03:42:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058245803 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:42:34.181922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:34.182404 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:34.189305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:34.189763 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:34.197199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:34.197199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:34.205314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] HTTP exception thrown: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Request method failure captured: May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 HTTP/1.1 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb1UkdQRkv3TQQ8OhP0E7bfOnGgxdCSJQ15KnSFlFfIeqY0XxQ3462PdJdTQ8d1PbZVIpvZDx_9oJKwb2E02-c1T9JxhN9AZI32BZCESPDlRfjw9DzwdpRVGJcALRVI2Y_Lki--VgdmohYUZHgNK93fbgOl7mtbCt-pjTgsvI1Yv9U May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:42:34.206926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1377b9e588bd44f3b29b03728c418151", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1377b9e588bd44f3b29b03728c418151"}]}] May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 104a135932a144269f1f2aa7359098ed May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.209378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '9baead13-4dfc-47d4-a5d3-5a0a4b760f45'} May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:34.210520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.211869 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:34.213780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Returning 404 to user: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:34.213780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6c540654-7636-495e-9844-691992a197e1 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 404 len: 111 microversion: 2.20 time: 0.030485 May 27 03:42:34.213780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 437/880] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 27 03:42:34 2022] DELETE /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:42:34.219760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:34.220589 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: 9baead13-4dfc-47d4-a5d3-5a0a4b760f45] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:34.240740 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:34.241197 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:34.242769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:34.242769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:34.256417 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] HTTP exception thrown: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Request method failure captured: May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 HTTP/1.1 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb1UkdQRkv3TQQ8OhP0E7bfOnGgxdCSJQ15KnSFlFfIeqY0XxQ3462PdJdTQ8d1PbZVIpvZDx_9oJKwb2E02-c1T9JxhN9AZI32BZCESPDlRfjw9DzwdpRVGJcALRVI2Y_Lki--VgdmohYUZHgNK93fbgOl7mtbCt-pjTgsvI1Yv9U May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:42:34.257978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1377b9e588bd44f3b29b03728c418151", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1377b9e588bd44f3b29b03728c418151"}]}] May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 104a135932a144269f1f2aa7359098ed May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.259690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '9baead13-4dfc-47d4-a5d3-5a0a4b760f45'} May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:34.260539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. May 27 03:42:34.261936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:34.263237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Returning 404 to user: Instance 9baead13-4dfc-47d4-a5d3-5a0a4b760f45 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:34.263237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e776591f-cb53-433b-b78f-ce072e212fe5 tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45" status: 404 len: 111 microversion: 2.20 time: 0.044657 May 27 03:42:34.263237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 444/881] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:34 2022] GET /compute/v2.1/servers/9baead13-4dfc-47d4-a5d3-5a0a4b760f45 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:42:35.588367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:35.588846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:35.595396 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:35.595845 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:35.596594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:35.597028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:35.610821 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] HTTP exception thrown: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Request method failure captured: May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 HTTP/1.1 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEb1UkdQRkv3TQQ8OhP0E7bfOnGgxdCSJQ15KnSFlFfIeqY0XxQ3462PdJdTQ8d1PbZVIpvZDx_9oJKwb2E02-c1T9JxhN9AZI32BZCESPDlRfjw9DzwdpRVGJcALRVI2Y_Lki--VgdmohYUZHgNK93fbgOl7mtbCt-pjTgsvI1Yv9U May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:42:35.612533 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1377b9e588bd44f3b29b03728c418151", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1377b9e588bd44f3b29b03728c418151"}]}] May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 104a135932a144269f1f2aa7359098ed May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.614091 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': 'c0670a31-c2d9-43c0-85a8-e15e7513a629'} May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:35.614973 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.616463 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:35.617799 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Returning 404 to user: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:35.617799 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a3b8d8b1-2528-436a-ae2d-84af60eb0fcd tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 404 len: 111 microversion: 2.20 time: 0.029492 May 27 03:42:35.617799 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 438/882] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 27 03:42:35 2022] DELETE /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:42:35.622588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:35.623276 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] [instance: c0670a31-c2d9-43c0-85a8-e15e7513a629] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:35.629704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:35.630644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:35.631438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:35.631875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:35.645122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] HTTP exception thrown: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Request method failure captured: May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 HTTP/1.1 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEb1UkdQRkv3TQQ8OhP0E7bfOnGgxdCSJQ15KnSFlFfIeqY0XxQ3462PdJdTQ8d1PbZVIpvZDx_9oJKwb2E02-c1T9JxhN9AZI32BZCESPDlRfjw9DzwdpRVGJcALRVI2Y_Lki--VgdmohYUZHgNK93fbgOl7mtbCt-pjTgsvI1Yv9U May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:42:35.647297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1377b9e588bd44f3b29b03728c418151", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1377b9e588bd44f3b29b03728c418151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1377b9e588bd44f3b29b03728c418151"}]}] May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 1377b9e588bd44f3b29b03728c418151 May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1207782569 May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 104a135932a144269f1f2aa7359098ed May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1207782569-project May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.648894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'c0670a31-c2d9-43c0-85a8-e15e7513a629'} May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:35.649763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. May 27 03:42:35.651253 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:35.652515 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] Returning 404 to user: Instance c0670a31-c2d9-43c0-85a8-e15e7513a629 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:35.652515 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-23780dc0-d536-4d50-9857-0e06ad01a71b tempest-AttachVolumeShelveTestJSON-1207782569 tempest-AttachVolumeShelveTestJSON-1207782569-project] 10.222.0.24 "GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629" status: 404 len: 111 microversion: 2.20 time: 0.029995 May 27 03:42:35.652515 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 445/883] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 27 03:42:35 2022] GET /compute/v2.1/servers/c0670a31-c2d9-43c0-85a8-e15e7513a629 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:42:39.996259 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:39.996788 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:40.003451 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:40.003898 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:40.004648 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:40.005083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:40.028275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6b3cea7c-2200-4b09-8393-47d306a66c58 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/ips" status: 200 len: 144 microversion: 2.1 time: 0.035927 May 27 03:42:40.028849 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 439/884] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:42:39 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:41.916339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-83dbb1bc-0c4d-4c19-9269-34f21347bced tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Action: 'create', calling method: .version_select at 0x7f3046511b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-910427356"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:42.827063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-83dbb1bc-0c4d-4c19-9269-34f21347bced tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.033335 May 27 03:42:42.827701 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 446/885] 10.222.0.24 () {60 vars in 1154 bytes} [Fri May 27 03:42:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1035 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 03:42:42.839324 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c176c695-9403-49b5-b594-68876f066823 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30467d9310>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:42.899552 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c642ab-12f0-42cd-9d93-6bf5c34e412c"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:42.900963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:42.908754 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:42.909201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:42.909970 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:42.910401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:42.921656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c176c695-9403-49b5-b594-68876f066823 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 200 len: 344 microversion: 2.1 time: 0.086012 May 27 03:42:42.922222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 440/886] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:42 2022] GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:43.920198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-108c8df4-11ee-4ca9-b640-35ee09a550e0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.027526 May 27 03:42:43.920841 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 447/887] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:42:42 2022] POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:42:43.934252 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c230d833-7666-4147-8327-78c2866485eb tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30467ff8b0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:43.983418 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c230d833-7666-4147-8327-78c2866485eb tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 200 len: 345 microversion: 2.1 time: 0.053363 May 27 03:42:43.984011 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 441/888] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:43 2022] GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:43.996354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9bb47f1e-0dbd-4ada-9c04-80c6178eb2cb tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Action: 'create', calling method: .version_select at 0x7f30466d6160>, body: {"snapshot": {"volume_id": "1cf9949b-e488-4451-b993-0b91b22787e0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1116634718"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:44.777320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9bb47f1e-0dbd-4ada-9c04-80c6178eb2cb tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.785142 May 27 03:42:44.778022 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 448/889] 10.222.0.24 () {60 vars in 1161 bytes} [Fri May 27 03:42:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:42:44.788989 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8427d40d-ee66-4afc-84c8-1ee6f26a7340 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f304681c1f0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:44.838149 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8427d40d-ee66-4afc-84c8-1ee6f26a7340 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 200 len: 287 microversion: 2.1 time: 0.053906 May 27 03:42:44.839173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 442/890] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:44 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:44.850497 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d9684867-5b8b-4d0e-ad38-908d7c3d80b1 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30467d83a0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:44.893240 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d9684867-5b8b-4d0e-ad38-908d7c3d80b1 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047240 May 27 03:42:44.893817 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 449/891] 10.222.0.24 () {58 vars in 1139 bytes} [Fri May 27 03:42:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:44.904063 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c9299437-7f83-4890-b7f6-210ed5a618e2 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f304681cdc0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:45.212708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c9299437-7f83-4890-b7f6-210ed5a618e2 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 200 len: 287 microversion: 2.1 time: 0.312428 May 27 03:42:45.213292 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 443/892] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:44 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 287 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:42:46.225864 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b66f3cf8-5ec7-49be-a3c7-c7948f28e3d8 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f3046869820>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:46.254949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b66f3cf8-5ec7-49be-a3c7-c7948f28e3d8 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 200 len: 287 microversion: 2.1 time: 0.033957 May 27 03:42:46.255528 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 450/893] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:46 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:47.267569 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4da5e944-2077-4393-89d6-0945d0c27110 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f3046835280>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:47.297700 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4da5e944-2077-4393-89d6-0945d0c27110 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 200 len: 287 microversion: 2.1 time: 0.034821 May 27 03:42:47.298285 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 444/894] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:47 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:48.309974 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9999155a-f075-438d-98e2-bb2a17c92c71 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30467a04c0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:48.340838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9999155a-f075-438d-98e2-bb2a17c92c71 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 200 len: 288 microversion: 2.1 time: 0.033545 May 27 03:42:48.340838 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 451/895] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:48 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:48.350658 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c572037a-071c-4ad8-aaee-b9934495bbb5 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f3046851430>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:48.612946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c572037a-071c-4ad8-aaee-b9934495bbb5 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 202 len: 0 microversion: 2.1 time: 0.266724 May 27 03:42:48.613582 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 445/896] 10.222.0.24 () {58 vars in 1253 bytes} [Fri May 27 03:42:48 2022] DELETE /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:48.622485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-eeda75ad-7d69-4d08-bf4a-a124dde5c0c0 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f3046510310>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:48.651321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-eeda75ad-7d69-4d08-bf4a-a124dde5c0c0 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 200 len: 287 microversion: 2.1 time: 0.032662 May 27 03:42:48.651877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 452/897] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:48 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:49.663506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7be7f558-3fac-484d-92bd-95bea3c14538 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30466fda60>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:49.688948 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-7be7f558-3fac-484d-92bd-95bea3c14538 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] HTTP exception thrown: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7be7f558-3fac-484d-92bd-95bea3c14538 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Request method failure captured: May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e HTTP/1.1 May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEixMslCVy1OVcia_VRnH_ehgT8WxUn4u1vW1Y4EkFQCSUg6PBqJ2JyacCeCOvohYHwVtR5SNxk33d-fGCG4O8EVCVMl3ueT4F2pOJOtbldyfpqY1kqgGm1U2Ro--m67_4Z_8V8o4EOwLtXCZhbYyBisHB4ouKH_zKVzKoEzpnvjiDU May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:42:49.699839 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_a51d843f78a54e8b9dbba4ab9b28accf", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/a51d843f78a54e8b9dbba4ab9b28accf"}]}] May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 998a4598a29849908051773834fe55ad May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '00f3e995-ef01-4449-b55c-1338cc2c711e'} May 27 03:42:49.702279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. (HTTP 404) (Request-ID: req-fca5ddb7-fb4b-47d7-acdc-a518b194ca58) May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.703372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:42:49.704748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 03:42:49.706108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7be7f558-3fac-484d-92bd-95bea3c14538 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Returning 404 to user: Snapshot 00f3e995-ef01-4449-b55c-1338cc2c711e could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7be7f558-3fac-484d-92bd-95bea3c14538 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e" status: 404 len: 111 microversion: 2.1 time: 0.042182 May 27 03:42:49.707713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 446/898] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 27 03:42:49 2022] GET /compute/v2.1/os-snapshots/00f3e995-ef01-4449-b55c-1338cc2c711e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:42:49.711362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-481ceb68-e9f0-4fb7-867a-6d2985c61d1a tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30467c75e0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:49.956391 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-481ceb68-e9f0-4fb7-867a-6d2985c61d1a tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 202 len: 0 microversion: 2.1 time: 0.249824 May 27 03:42:49.957113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 453/899] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:42:49 2022] DELETE /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:49.965730 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-92af1964-1e0c-4d95-884e-8ec3a484001f tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30468cedc0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:50.002028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:50.016520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-92af1964-1e0c-4d95-884e-8ec3a484001f tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 200 len: 344 microversion: 2.1 time: 0.054579 May 27 03:42:50.017133 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 447/900] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:49 2022] GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:51.029730 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-89ab04ea-0931-4a18-8400-45cc35116f23 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30465f9160>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:51.056640 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-89ab04ea-0931-4a18-8400-45cc35116f23 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] HTTP exception thrown: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-89ab04ea-0931-4a18-8400-45cc35116f23 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Request method failure captured: May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 HTTP/1.1 May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEixMslCVy1OVcia_VRnH_ehgT8WxUn4u1vW1Y4EkFQCSUg6PBqJ2JyacCeCOvohYHwVtR5SNxk33d-fGCG4O8EVCVMl3ueT4F2pOJOtbldyfpqY1kqgGm1U2Ro--m67_4Z_8V8o4EOwLtXCZhbYyBisHB4ouKH_zKVzKoEzpnvjiDU May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:42:51.058718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_a51d843f78a54e8b9dbba4ab9b28accf", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/a51d843f78a54e8b9dbba4ab9b28accf"}]}] May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 998a4598a29849908051773834fe55ad May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '1cf9949b-e488-4451-b993-0b91b22787e0'} May 27 03:42:51.060224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. (HTTP 404) (Request-ID: req-0806fed6-1ee5-48b7-bb51-496b370f32c3) May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.061228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:42:51.062583 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:42:51.065996 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-89ab04ea-0931-4a18-8400-45cc35116f23 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Returning 404 to user: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-89ab04ea-0931-4a18-8400-45cc35116f23 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 404 len: 109 microversion: 2.1 time: 0.035001 May 27 03:42:51.067995 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 454/901] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:51 2022] GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:51.071032 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:51.075846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-83d55f21-ae34-4634-b986-9501442e6f08 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30466fdb80>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:51.106925 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-83d55f21-ae34-4634-b986-9501442e6f08 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] HTTP exception thrown: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-83d55f21-ae34-4634-b986-9501442e6f08 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Request method failure captured: May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 HTTP/1.1 May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEixMslCVy1OVcia_VRnH_ehgT8WxUn4u1vW1Y4EkFQCSUg6PBqJ2JyacCeCOvohYHwVtR5SNxk33d-fGCG4O8EVCVMl3ueT4F2pOJOtbldyfpqY1kqgGm1U2Ro--m67_4Z_8V8o4EOwLtXCZhbYyBisHB4ouKH_zKVzKoEzpnvjiDU May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:42:51.110981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_a51d843f78a54e8b9dbba4ab9b28accf", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/a51d843f78a54e8b9dbba4ab9b28accf"}]}] May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 998a4598a29849908051773834fe55ad May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '1cf9949b-e488-4451-b993-0b91b22787e0'} May 27 03:42:51.113287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. (HTTP 404) (Request-ID: req-78d6be59-12d5-42ee-b1df-6db059c82289) May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.114756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:42:51.116137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:42:51.117646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:42:51.119178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-83d55f21-ae34-4634-b986-9501442e6f08 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Returning 404 to user: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:51.121190 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-83d55f21-ae34-4634-b986-9501442e6f08 tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 404 len: 109 microversion: 2.1 time: 0.041196 May 27 03:42:51.121474 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 448/902] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:42:51 2022] DELETE /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:51.130644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f9f3d64e-fd12-4523-a5c8-ecc61191830c tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Calling method '.version_select at 0x7f30465f9280>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:51.161819 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-f9f3d64e-fd12-4523-a5c8-ecc61191830c tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] HTTP exception thrown: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f9f3d64e-fd12-4523-a5c8-ecc61191830c tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Request method failure captured: May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 HTTP/1.1 May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEixMslCVy1OVcia_VRnH_ehgT8WxUn4u1vW1Y4EkFQCSUg6PBqJ2JyacCeCOvohYHwVtR5SNxk33d-fGCG4O8EVCVMl3ueT4F2pOJOtbldyfpqY1kqgGm1U2Ro--m67_4Z_8V8o4EOwLtXCZhbYyBisHB4ouKH_zKVzKoEzpnvjiDU May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:42:51.163890 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_a51d843f78a54e8b9dbba4ab9b28accf", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/a51d843f78a54e8b9dbba4ab9b28accf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/a51d843f78a54e8b9dbba4ab9b28accf"}]}] May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: a51d843f78a54e8b9dbba4ab9b28accf May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-816443318 May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 998a4598a29849908051773834fe55ad May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-816443318-project May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '1cf9949b-e488-4451-b993-0b91b22787e0'} May 27 03:42:51.165381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. (HTTP 404) (Request-ID: req-6928c921-ad67-4865-8183-7e0f6c705bbe) May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.166320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:42:51.167720 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:42:51.169335 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. May 27 03:42:51.170764 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:42:51.172321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f9f3d64e-fd12-4523-a5c8-ecc61191830c tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] Returning 404 to user: Volume 1cf9949b-e488-4451-b993-0b91b22787e0 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:42:51.173173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f9f3d64e-fd12-4523-a5c8-ecc61191830c tempest-VolumesSnapshotsTestJSON-816443318 tempest-VolumesSnapshotsTestJSON-816443318-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0" status: 404 len: 109 microversion: 2.1 time: 0.047123 May 27 03:42:51.173732 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 455/903] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:51 2022] GET /compute/v2.1/os-volumes/1cf9949b-e488-4451-b993-0b91b22787e0 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:51.663826 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-172ec9ec-287c-401d-9f9e-cd715f8da2e8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:51.672487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-172ec9ec-287c-401d-9f9e-cd715f8da2e8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:51.673062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-172ec9ec-287c-401d-9f9e-cd715f8da2e8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:51.735576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-172ec9ec-287c-401d-9f9e-cd715f8da2e8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Going to try to stop instance {{(pid=124771) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 03:42:51.997715 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-172ec9ec-287c-401d-9f9e-cd715f8da2e8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action" status: 202 len: 0 microversion: 2.1 time: 0.338652 May 27 03:42:51.998916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 449/904] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:42:51 2022] POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:52.007331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:52.008458 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:52.010687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:52.016972 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:52.017431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:52.018428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:52.018899 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:52.023172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:52.168648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:52.178799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-116dde4b-2360-44d3-a4e1-46055645234e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.176031 May 27 03:42:52.179450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 456/905] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:52 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:53.198304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:53.199683 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:53.207107 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:53.207564 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:53.209147 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:53.209582 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:53.340474 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:53.349196 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-74aa5b62-9819-45b7-8be0-34d4a877ee39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.155805 May 27 03:42:53.350263 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 450/906] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:53 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:54.367362 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:54.367975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:54.375734 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:54.376193 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:54.376971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:54.377405 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:54.510186 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:54.518158 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-65dc2981-a3bf-41f0-a8a8-c7403eca4592 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.155549 May 27 03:42:54.518722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 457/907] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:54 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:55.278665 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-47e18bf2-cdce-431b-8cfb-455c41373b18 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30467d9e50>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:55.326731 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-47e18bf2-cdce-431b-8cfb-455c41373b18 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/9555cabf-f00a-420c-8ba5-bf1ec06cff83" status: 200 len: 351 microversion: 2.1 time: 0.051969 May 27 03:42:55.327541 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 451/908] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:55 2022] GET /compute/v2.1/os-volumes/9555cabf-f00a-420c-8ba5-bf1ec06cff83 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:55.536936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:55.537690 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:55.545083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:55.545512 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:55.546280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:55.546722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:55.702038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:55.711057 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3aa44046-3dd6-42cf-bd40-fbc95da1753e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.179191 May 27 03:42:55.711645 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 458/909] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:55 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:56.729443 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:56.730118 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:56.736887 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:56.737330 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:56.738084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:56.738513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:56.873345 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:56.881842 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-10051ab7-8ca5-4488-bd35-53ab9de11542 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.156884 May 27 03:42:56.882415 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 452/910] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:56 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:56.979472 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5031bf78-e4a3-4119-834b-dd9d5d2849e1 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30467ccd30>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:57.029068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5031bf78-e4a3-4119-834b-dd9d5d2849e1 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ccaa52ee-8a53-48af-bd20-df5638e09182" status: 200 len: 350 microversion: 2.1 time: 0.053432 May 27 03:42:57.029639 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 459/911] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:56 2022] GET /compute/v2.1/os-volumes/ccaa52ee-8a53-48af-bd20-df5638e09182 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:57.898491 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:57.899153 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:57.905785 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:57.906245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:57.907046 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:57.907486 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:58.038608 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:58.046690 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f03540e-a026-42aa-98ce-1a1dfe8e3c7f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.152565 May 27 03:42:58.047292 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 453/912] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:57 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:58.648554 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f57d2957-cf08-47b8-a4b8-8f63640367e0 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30465e7790>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:58.699319 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f57d2957-cf08-47b8-a4b8-8f63640367e0 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b4b70dbc-4130-4429-a377-6472d4ca0e90" status: 200 len: 351 microversion: 2.1 time: 0.050710 May 27 03:42:58.699319 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 460/913] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 27 03:42:58 2022] GET /compute/v2.1/os-volumes/b4b70dbc-4130-4429-a377-6472d4ca0e90 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:58.706953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6fa2463d-1c39-4328-a669-6e8d65cd69c5 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30466bea60>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:58.789165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6fa2463d-1c39-4328-a669-6e8d65cd69c5 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085926 May 27 03:42:58.789827 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 454/914] 10.222.0.24 () {58 vars in 1133 bytes} [Fri May 27 03:42:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:58.801810 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-307762cb-ab35-4cb8-baa6-836f22f1c8d2 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30466d6dc0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:58.884173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-307762cb-ab35-4cb8-baa6-836f22f1c8d2 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086160 May 27 03:42:58.884749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 461/915] 10.222.0.24 () {58 vars in 1148 bytes} [Fri May 27 03:42:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:42:58.896360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d0c7f03b-b472-4b56-b8b8-6b5540044598 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30468ce1f0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:58.974548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d0c7f03b-b472-4b56-b8b8-6b5540044598 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081914 May 27 03:42:58.975183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 455/916] 10.222.0.24 () {58 vars in 1133 bytes} [Fri May 27 03:42:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:58.986249 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-53221d88-86df-4e8f-96c9-33563bfccb97 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30465eae50>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.065819 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.066541 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:42:59.067849 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-53221d88-86df-4e8f-96c9-33563bfccb97 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084678 May 27 03:42:59.068429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 462/917] 10.222.0.24 () {58 vars in 1166 bytes} [Fri May 27 03:42:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:59.079367 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:59.079621 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:59.080387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:42:59.080818 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:42:59.086937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d84020ce-c002-481c-b586-1db97c13a4a8 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30467cc040>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.169877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d84020ce-c002-481c-b586-1db97c13a4a8 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090253 May 27 03:42:59.169877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 463/918] 10.222.0.24 () {58 vars in 1169 bytes} [Fri May 27 03:42:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:59.182074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6ed4be7a-afdf-497f-ba18-306bf0e6e282 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30467afee0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.216863 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:59.225329 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fdc08bc1-3461-45e8-99a9-9134da204272 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.164335 May 27 03:42:59.225888 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 456/919] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:42:59 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:59.262094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6ed4be7a-afdf-497f-ba18-306bf0e6e282 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084294 May 27 03:42:59.262672 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 464/920] 10.222.0.24 () {58 vars in 1154 bytes} [Fri May 27 03:42:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:59.273708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f375f70f-88c6-48e3-b3b1-a57ed7e9c6e2 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30468cee50>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.358498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f375f70f-88c6-48e3-b3b1-a57ed7e9c6e2 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088570 May 27 03:42:59.359494 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 457/921] 10.222.0.24 () {58 vars in 1187 bytes} [Fri May 27 03:42:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:59.371776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-98413fb7-83fb-4a22-ad09-0179d470c555 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] Calling method '.version_select at 0x7f30465100d0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.455848 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-98413fb7-83fb-4a22-ad09-0179d470c555 tempest-VolumesTestJSON-1675242579 tempest-VolumesTestJSON-1675242579-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087790 May 27 03:42:59.456419 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 465/922] 10.222.0.24 () {58 vars in 1154 bytes} [Fri May 27 03:42:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:00.243127 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:00.243737 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:00.250354 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:00.250802 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:00.251574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:00.252003 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:00.392502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:00.400442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-73f134d8-50a9-45fa-87ee-58547d8dc504 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.162358 May 27 03:43:00.401183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 458/923] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:00 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:01.417137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:01.417746 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:01.423864 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:01.424316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:01.425079 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:01.425516 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:01.568816 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:01.576979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d9abbf10-53c0-4a6a-844f-894633b4496b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.164133 May 27 03:43:01.577847 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 466/924] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:01 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:02.594914 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:02.595536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:02.602712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:02.603141 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:02.603900 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:02.604339 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:02.732755 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:02.740874 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-30f14204-fce9-480a-a4ac-8f8534143382 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.149805 May 27 03:43:02.741436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 459/925] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:02 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:03.671219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1138621084", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "networks": [{"uuid": "957f92df-3f90-4ab3-b244-3c908e00f069"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:03.728870 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] validate_networks() for [('957f92df-3f90-4ab3-b244-3c908e00f069', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:43:03.757729 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:03.758335 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:03.764956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:03.765338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:03.766089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:03.766518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:03.944507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:03.953446 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-84476348-4a14-4e65-a130-2ce6dfded989 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.199901 May 27 03:43:03.954216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 460/926] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:03 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:04.237394 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:43:04.242788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:43:04.242788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:43:04.242788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:43:04.242788 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:43:04.248980 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:04.249427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:04.250236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:04.250671 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:04.268604 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Getting quotas for project 245626825e3b480485223cd0e3d54580. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:43:04.272641 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Getting quotas for user 1e33fbb258684a00a7a8d948d92a8c01 and project 245626825e3b480485223cd0e3d54580. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:43:04.288107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:43:04.290571 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:43:04.432349 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ee0835d1-1b05-4ea0-9559-6a2d845add22 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764916 May 27 03:43:04.433164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 467/927] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:43:04.443187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-97957dfd-0851-4911-b111-592b9b615863 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:04.443801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-97957dfd-0851-4911-b111-592b9b615863 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:04.503088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-97957dfd-0851-4911-b111-592b9b615863 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:04.510197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-97957dfd-0851-4911-b111-592b9b615863 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1219 microversion: 2.1 time: 0.070953 May 27 03:43:04.510771 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 461/928] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:04 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:04.971493 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:04.972107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:04.980826 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:04.981285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:04.982092 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:04.982531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:05.121510 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:05.129672 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f38e7b1d-8792-48c5-ad24-9727b8ef4054 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.162505 May 27 03:43:05.130326 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 468/929] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:04 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:05.527061 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d38b83bb-fff2-45a1-91ef-59a3909da51d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:05.527684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d38b83bb-fff2-45a1-91ef-59a3909da51d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:05.581421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d38b83bb-fff2-45a1-91ef-59a3909da51d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:05.589215 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d38b83bb-fff2-45a1-91ef-59a3909da51d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1219 microversion: 2.1 time: 0.066167 May 27 03:43:05.589781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 462/930] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:05 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:06.147876 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:06.148497 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:06.155181 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:06.155638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:06.156407 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:06.156851 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:06.299670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:06.308791 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ce0af106-4a42-424e-b542-8e4d7e7f3ff2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.165414 May 27 03:43:06.310874 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 469/931] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:06 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:06.605895 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:06.606500 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:06.612918 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:06.613377 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:06.614695 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:06.615151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:06.679670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:06.683792 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-43fa8151-c83a-41ed-8ceb-0b8c2812c87e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1271 microversion: 2.1 time: 0.081651 May 27 03:43:06.684632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 463/932] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:06 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:07.327076 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:07.328207 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:07.335587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:07.336256 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:07.337028 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:07.337463 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:07.475426 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:07.484697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-de5b5e66-c41f-4f32-8490-04ad298fed28 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1722 microversion: 2.1 time: 0.162055 May 27 03:43:07.485531 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 470/933] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:07 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:07.702716 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:07.703361 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:07.710990 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:07.711452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:07.712229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:07.712663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:07.866034 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:07.873992 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c2a512a4-6db5-4df0-a308-14de8c0beec6 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.175313 May 27 03:43:07.874857 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 464/934] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:07 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:08.501626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:08.502288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:08.508822 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.509281 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.510053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.510489 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.639737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:08.648284 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3d532c0c-38e6-4411-90a6-cf6ff575168c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1699 microversion: 2.1 time: 0.150722 May 27 03:43:08.648856 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 471/935] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:08 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:08.665380 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-189bc0e9-d6c2-427b-918b-e6d659f741bf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:08.671655 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-189bc0e9-d6c2-427b-918b-e6d659f741bf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.672122 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-189bc0e9-d6c2-427b-918b-e6d659f741bf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.694549 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-189bc0e9-d6c2-427b-918b-e6d659f741bf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Going to try to start instance {{(pid=124771) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 03:43:08.720364 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-cb482fb4-921f-4ae2-88e6-5afe1a3b4b5c req-db795ad0-5279-43a6-abfc-4eb14ee3d516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637fee42-bec3-4b04-adac-b90160f3b41a", "tag": "455a2f6f-8f96-4c46-8788-171155ad5030"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:08.731902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-cb482fb4-921f-4ae2-88e6-5afe1a3b4b5c req-db795ad0-5279-43a6-abfc-4eb14ee3d516 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.732955 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-cb482fb4-921f-4ae2-88e6-5afe1a3b4b5c req-db795ad0-5279-43a6-abfc-4eb14ee3d516 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.745268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-cb482fb4-921f-4ae2-88e6-5afe1a3b4b5c req-db795ad0-5279-43a6-abfc-4eb14ee3d516 service nova] Creating event network-changed:455a2f6f-8f96-4c46-8788-171155ad5030 for instance 637fee42-bec3-4b04-adac-b90160f3b41a on hv-cinder-82880 May 27 03:43:08.757999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-cb482fb4-921f-4ae2-88e6-5afe1a3b4b5c req-db795ad0-5279-43a6-abfc-4eb14ee3d516 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043413 May 27 03:43:08.758619 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 472/936] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:43:08.892984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:08.893623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:08.900438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.900887 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.901643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.902073 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.959815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-189bc0e9-d6c2-427b-918b-e6d659f741bf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action" status: 202 len: 0 microversion: 2.1 time: 0.298710 May 27 03:43:08.960854 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 465/937] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:43:08 2022] POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:08.978180 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:08.978936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:08.985405 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.985858 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:08.986877 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:08.987317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:09.050343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:09.057922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8bf41caa-eace-41ba-8a70-e770074f5dd4 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.169162 May 27 03:43:09.058692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 473/938] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:08 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:09.138316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:09.147238 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d17844e4-5bad-45d4-98f7-c5517c59c144 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1708 microversion: 2.1 time: 0.174870 May 27 03:43:09.147748 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 466/939] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:08 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:10.075431 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:10.076282 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:10.083983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:10.084750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:10.085787 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:10.086322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:10.165470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:10.166175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:10.172881 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:10.173337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:10.174102 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:10.174538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:10.229004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:10.236566 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8db7dfac-6f4e-4c3f-aac5-5d667ae5a17d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.165058 May 27 03:43:10.237331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 474/940] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:10 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:10.314124 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:10.322988 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ac4e6f01-7465-4066-8301-c549b4d716f3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1708 microversion: 2.1 time: 0.161481 May 27 03:43:10.323565 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 467/941] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:10 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:11.265423 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:11.266025 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:11.272539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:11.272981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:11.273737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:11.274168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:11.340421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:11.341621 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:11.348567 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:11.349048 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:11.349775 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:11.350201 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:11.439060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:11.450402 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a4f55a8d-062f-454e-848a-ee1defdeb8bd tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.188544 May 27 03:43:11.451558 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 475/942] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:11 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:11.501671 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:11.509905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ca974101-5b63-440e-9ef8-75d530616a03 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1708 microversion: 2.1 time: 0.173450 May 27 03:43:11.510462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 468/943] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:11 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:12.472359 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:12.472997 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:12.479471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:12.479946 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:12.480758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:12.481236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:12.527468 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:12.528089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:12.535103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:12.535590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:12.536368 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:12.536801 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:12.557219 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:12.682865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:12.693500 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-42d3df5c-0b04-4ee8-a2b5-67dc30ec564c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.225096 May 27 03:43:12.694762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 476/944] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:12 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:12.709876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:12.718145 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-339e4e86-3897-47d8-ab96-1161eb29d369 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1712 microversion: 2.1 time: 0.194650 May 27 03:43:12.720742 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 469/945] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:12 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1712 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:13.711522 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:13.712131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:13.718707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:13.719188 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:13.719949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:13.720386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:13.853930 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:13.861670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-85c6dd85-dcd1-44b1-be8f-019182d510b0 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.154282 May 27 03:43:13.862429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 477/946] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:13 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:14.378470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6ed99de1-acab-46a5-bee3-8407a5b759d6 req-377c7df3-6be7-42c3-9d6c-966bb0027758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637fee42-bec3-4b04-adac-b90160f3b41a", "name": "network-vif-plugged", "status": "completed", "tag": "455a2f6f-8f96-4c46-8788-171155ad5030"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:14.389151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6ed99de1-acab-46a5-bee3-8407a5b759d6 req-377c7df3-6be7-42c3-9d6c-966bb0027758 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:14.389574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6ed99de1-acab-46a5-bee3-8407a5b759d6 req-377c7df3-6be7-42c3-9d6c-966bb0027758 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:14.401182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6ed99de1-acab-46a5-bee3-8407a5b759d6 req-377c7df3-6be7-42c3-9d6c-966bb0027758 service nova] Creating event network-vif-plugged:455a2f6f-8f96-4c46-8788-171155ad5030 for instance 637fee42-bec3-4b04-adac-b90160f3b41a on hv-cinder-82880 May 27 03:43:14.406498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6ed99de1-acab-46a5-bee3-8407a5b759d6 req-377c7df3-6be7-42c3-9d6c-966bb0027758 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 May 27 03:43:14.407306 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 470/947] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:14.878800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:14.879482 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:14.881621 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:14.882282 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:14.887979 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:14.888427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:14.889205 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:14.889642 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:15.017159 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:15.024631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-506a364f-1fb2-4f74-a352-8676a09cef9d tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1319 microversion: 2.1 time: 0.149740 May 27 03:43:15.025199 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 478/948] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:14 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:16.041838 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:16.042546 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:16.047946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:16.050170 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:16.050721 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:16.051904 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:16.052346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:16.185735 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:16.193356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e2c5516c-ed9f-4546-a2b7-430331b4a3e8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1508 microversion: 2.1 time: 0.156194 May 27 03:43:16.193926 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 471/949] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:16 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:27.383866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-861991245", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:27.389797 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:27.390512 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=87 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:27.437821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] validate_networks() for None {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:43:27.715962 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:43:27.716380 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:43:27.716848 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:43:27.717252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:43:27.717657 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:43:27.726994 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:27.727441 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:27.728232 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:27.728661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:27.746363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Getting quotas for project ca4cb6938b5e4a43bc37f2dc498838c3. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:43:27.750288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Getting quotas for user 900ea7e299e34a2d866bef87773b2a8e and project ca4cb6938b5e4a43bc37f2dc498838c3. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:43:27.761623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:43:27.763895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:43:27.927379 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6cb54642-eb0e-4b4d-b12c-97d173441ea3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547397 May 27 03:43:27.928506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 479/950] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:43:27.942530 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f39d274c-4aed-4f7d-9cda-0361330bd084 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:27.943192 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f39d274c-4aed-4f7d-9cda-0361330bd084 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:27.945727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=42 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:27.946632 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=10 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:28.002575 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f39d274c-4aed-4f7d-9cda-0361330bd084 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:28.010096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f39d274c-4aed-4f7d-9cda-0361330bd084 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1214 microversion: 2.1 time: 0.071962 May 27 03:43:28.010656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 472/951] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:27 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:29.028291 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:29.028926 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:29.035123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:29.035569 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:29.036325 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:29.036762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:29.100760 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:29.108201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e8e52c27-76c4-4efd-8bc4-4da434ff4ba0 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1218 microversion: 2.1 time: 0.084431 May 27 03:43:29.108768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 480/952] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:29 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:30.125112 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:30.125727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:30.132690 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:30.134753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:30.134753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:30.134753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:30.456352 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:30.465408 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fa7b43da-3b4a-4121-894e-4357a6ebc5d5 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1266 microversion: 2.1 time: 0.344494 May 27 03:43:30.465989 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 473/953] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:30 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:31.512936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:31.512936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:31.512936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:31.512936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:31.514100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:31.514100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:31.637790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:31.645620 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-99d388d4-70c0-4a61-8d16-03a7ec5a3737 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.162074 May 27 03:43:31.646758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 481/954] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:31 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:32.452886 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-70e68595-827b-4edf-b1f0-2af69f96021d req-95a9e09d-bc6b-4cbd-bb0d-f8b45c72126b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1ac792-6ea1-44f9-9708-4ee966afa98c", "tag": "c35bc798-084c-481f-8678-a0c732428f1b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:32.464981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-70e68595-827b-4edf-b1f0-2af69f96021d req-95a9e09d-bc6b-4cbd-bb0d-f8b45c72126b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:32.465436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-70e68595-827b-4edf-b1f0-2af69f96021d req-95a9e09d-bc6b-4cbd-bb0d-f8b45c72126b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:32.480901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-70e68595-827b-4edf-b1f0-2af69f96021d req-95a9e09d-bc6b-4cbd-bb0d-f8b45c72126b service nova] Creating event network-changed:c35bc798-084c-481f-8678-a0c732428f1b for instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c on hv-cinder-82880 May 27 03:43:32.486637 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-70e68595-827b-4edf-b1f0-2af69f96021d req-95a9e09d-bc6b-4cbd-bb0d-f8b45c72126b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037421 May 27 03:43:32.487299 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 474/955] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:32.663278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:32.663872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:32.671338 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:32.679120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:32.679120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:32.679120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:32.806676 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:32.814971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5e0b9a48-1968-42ed-a66c-491db6c16e72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.156193 May 27 03:43:32.816010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 482/956] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:32 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:33.833315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:33.834314 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:33.840897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:33.841355 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:33.842034 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:33.842470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:33.889685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f20ecd5-8e67-4d09-9c31-2d064a74f096", "device": "/dev/sdb"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:33.891347 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:33.898301 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:33.898753 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:33.899565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:33.900005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:33.969711 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:33.979225 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8ae61afc-f1e0-4edb-83be-77899166d041 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.150454 May 27 03:43:33.980020 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 475/957] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:33 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:34.713034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9b62b14a-1701-4acc-b4ac-8ce5a5ce237c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "POST /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827125 May 27 03:43:34.713656 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 483/958] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:43:33 2022] POST /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:43:35.003097 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:35.003712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:35.010154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:35.010604 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:35.011387 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:35.011825 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:35.137856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:35.145256 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75d13366-856f-419e-92fe-68ac98df34b7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.146010 May 27 03:43:35.146300 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 476/959] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:34 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:36.163169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:36.163908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:36.170178 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:36.170623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:36.171447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:36.171884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:36.302196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:36.312200 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bc65732c-052b-4ae3-b215-26ce7c512907 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.153963 May 27 03:43:36.313025 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 484/960] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:36 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:37.328221 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:37.328831 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:37.335599 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:37.336047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:37.336798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:37.337229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:37.462275 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:37.469787 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-042b5f8f-fe91-4a43-81ae-fa541e4008d3 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.145484 May 27 03:43:37.470357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 477/961] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:37 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:38.486522 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:38.487163 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:38.489661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:38.490367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:38.495317 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:38.495772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:38.496548 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:38.496986 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:38.534484 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-15491d3a-56e0-453a-b962-1fe67ce91bcb req-8acea888-e805-4480-82d4-f147f1d3d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1ac792-6ea1-44f9-9708-4ee966afa98c", "name": "network-vif-plugged", "status": "completed", "tag": "c35bc798-084c-481f-8678-a0c732428f1b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:38.538191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:38.544596 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-15491d3a-56e0-453a-b962-1fe67ce91bcb req-8acea888-e805-4480-82d4-f147f1d3d8f0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:38.545043 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-15491d3a-56e0-453a-b962-1fe67ce91bcb req-8acea888-e805-4480-82d4-f147f1d3d8f0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:38.556570 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-15491d3a-56e0-453a-b962-1fe67ce91bcb req-8acea888-e805-4480-82d4-f147f1d3d8f0 service nova] Creating event network-vif-plugged:c35bc798-084c-481f-8678-a0c732428f1b for instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c on hv-cinder-82880 May 27 03:43:38.562500 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-15491d3a-56e0-453a-b962-1fe67ce91bcb req-8acea888-e805-4480-82d4-f147f1d3d8f0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031829 May 27 03:43:38.563157 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 478/962] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:38.631677 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:38.642444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-38bd5169-4941-48ab-9c40-e65905e0ff86 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.159866 May 27 03:43:38.643074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 485/963] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:38 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:39.660747 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:39.661364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:39.667540 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:39.667981 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:39.668721 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:39.669149 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:39.796383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:39.803868 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f27f63d-d41b-4bc1-a35b-419a4c6e4d72 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1314 microversion: 2.1 time: 0.148165 May 27 03:43:39.804428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 479/964] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:39 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:40.824736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:40.824736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:40.829508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:40.829976 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:40.830731 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:40.831333 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:40.965960 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:40.973449 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-177e072b-f50a-421f-8a8e-7ed532039b55 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1464 microversion: 2.1 time: 0.156002 May 27 03:43:40.974014 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 486/965] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:40 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:41.014031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:41.016084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:41.021141 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:41.021538 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:41.022286 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:41.022717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:41.048066 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:43:41.383907 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d9f1dec1-1a45-4140-8a7d-bcf23694efe7 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 204 len: 0 microversion: 2.1 time: 0.373796 May 27 03:43:41.384421 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 480/966] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:43:41 2022] DELETE /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:43:41.393289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:41.393906 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:41.400089 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:41.400540 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:41.401311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:41.401750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:41.526233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:41.533665 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-fb86b21a-9f5a-424b-be14-f69c51f80f91 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1470 microversion: 2.1 time: 0.144317 May 27 03:43:41.534226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 487/967] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:41 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1470 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:42.552757 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:42.553451 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:42.559894 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:42.560340 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:42.561094 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:42.561524 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:42.688077 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:42.695624 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e440dadd-f917-4465-9cf3-cc9e8157e305 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1470 microversion: 2.1 time: 0.147141 May 27 03:43:42.696195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 481/968] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:42 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:43.713079 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:43.713674 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:43.720967 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:43.721428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:43.722316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:43.722759 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:43.853946 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:43.862263 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c6b7843c-e4bf-4158-98ab-ace02bfec0bd tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1470 microversion: 2.1 time: 0.153393 May 27 03:43:43.862875 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 488/969] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:43 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:43.958536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-9bf7d241-348d-4735-9004-414d19c6551f req-df578c5e-affd-41de-8216-0e7f1963fea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1ac792-6ea1-44f9-9708-4ee966afa98c", "name": "network-vif-deleted", "tag": "c35bc798-084c-481f-8678-a0c732428f1b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:43.968676 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9bf7d241-348d-4735-9004-414d19c6551f req-df578c5e-affd-41de-8216-0e7f1963fea9 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:43.969231 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9bf7d241-348d-4735-9004-414d19c6551f req-df578c5e-affd-41de-8216-0e7f1963fea9 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:43.981258 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-9bf7d241-348d-4735-9004-414d19c6551f req-df578c5e-affd-41de-8216-0e7f1963fea9 service nova] Creating event network-vif-deleted:c35bc798-084c-481f-8678-a0c732428f1b for instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c on hv-cinder-82880 May 27 03:43:43.986208 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-9bf7d241-348d-4735-9004-414d19c6551f req-df578c5e-affd-41de-8216-0e7f1963fea9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 May 27 03:43:43.986803 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 482/970] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:44.881113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:44.882474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:44.889498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:44.889946 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:44.890872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:44.891311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:44.922050 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:44.922495 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:44.922963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lazy-loading 'fault' on Instance uuid 0e1ac792-6ea1-44f9-9708-4ee966afa98c {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:43:44.962951 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900ea7e299e34a2d866bef87773b2a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4cb6938b5e4a43bc37f2dc498838c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:44.971058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9cd71051-77df-41b6-8c47-b43a1e246a4d tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 200 len: 1304 microversion: 2.1 time: 0.096487 May 27 03:43:44.971713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 489/971] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:44 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:45.990022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:45.990736 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] [instance: 0e1ac792-6ea1-44f9-9708-4ee966afa98c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:45.996947 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:45.997419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:45.998197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:45.998626 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:46.011643 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] HTTP exception thrown: Instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c could not be found. May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Request method failure captured: May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c HTTP/1.1 May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEjdHc_QjD_d7-9pdFUjYKIX_vskI_aqAxMtey2fg_eiRaf0w5rivWH44Wz2yLTBlKiTIhVh1rBwELbuQQmUP---8LgzD2foSAOS1yYddFUJSzPQJPHgjOkjnKYnG3Mvlh2ZgFOu0UDLmLUeaky6s3DMRiBHkbKfiSKS1uEYCdi7KmE May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: ca4cb6938b5e4a43bc37f2dc498838c3 May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesNegativeTest-717307531 May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:43:46.013242 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ca4cb6938b5e4a43bc37f2dc498838c3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ca4cb6938b5e4a43bc37f2dc498838c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ca4cb6938b5e4a43bc37f2dc498838c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ca4cb6938b5e4a43bc37f2dc498838c3"}]}] May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesNegativeTest-717307531 May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: ca4cb6938b5e4a43bc37f2dc498838c3 May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesNegativeTest-717307531 May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesNegativeTest-717307531-project May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 900ea7e299e34a2d866bef87773b2a8e May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesNegativeTest-717307531-project May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c could not be found. May 27 03:43:46.014911 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '0e1ac792-6ea1-44f9-9708-4ee966afa98c'} May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c could not be found. May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:43:46.016070 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c could not be found. May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c could not be found. May 27 03:43:46.017670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:43:46.019166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] Returning 404 to user: Instance 0e1ac792-6ea1-44f9-9708-4ee966afa98c could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:43:46.019166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0104ebd7-4e55-4295-8c04-c2c6520a6374 tempest-VolumesNegativeTest-717307531 tempest-VolumesNegativeTest-717307531-project] 10.222.0.24 "GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c" status: 404 len: 111 microversion: 2.1 time: 0.029402 May 27 03:43:46.019166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 483/972] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:45 2022] GET /compute/v2.1/servers/0e1ac792-6ea1-44f9-9708-4ee966afa98c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:43:52.578064 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:52.578661 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:52.585455 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:52.585975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:52.586663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:52.587119 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:52.669187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lazy-loading 'services' on Instance uuid 87a65177-fd0d-4c44-a70a-d285315c23ee {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:43:52.897311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e875ff5b-c86b-4cd5-ae8d-571d2d00cf7b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-volume_attachments/d9c642ab-12f0-42cd-9d93-6bf5c34e412c" status: 202 len: 0 microversion: 2.1 time: 0.323464 May 27 03:43:52.897942 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 490/973] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:43:52 2022] DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-volume_attachments/d9c642ab-12f0-42cd-9d93-6bf5c34e412c => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:54.024672 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-80684619-7a5f-4748-b245-5fa87a56d302 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:54.033750 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-80684619-7a5f-4748-b245-5fa87a56d302 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:54.034454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-80684619-7a5f-4748-b245-5fa87a56d302 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:54.064442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-80684619-7a5f-4748-b245-5fa87a56d302 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Going to try to stop instance {{(pid=124771) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 03:43:54.349372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-80684619-7a5f-4748-b245-5fa87a56d302 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action" status: 202 len: 0 microversion: 2.1 time: 0.330335 May 27 03:43:54.350346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 484/974] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:43:54 2022] POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:54.366176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:54.366910 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:54.379423 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:54.380252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:54.380252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:54.381229 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:54.509319 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:54.517288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-cd722230-bd58-4608-97e7-195e825c393d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.162394 May 27 03:43:54.517845 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 491/975] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:54 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:55.535854 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:55.536568 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:55.542928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:55.543385 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:55.544152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:55.544597 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:55.679958 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:55.688034 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4eca27bf-3680-4016-abd1-9bbc8c48223d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.157449 May 27 03:43:55.688676 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 485/976] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:55 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:56.706075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:56.706679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:56.715052 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:56.716869 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:56.717224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:56.718547 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:56.848173 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:56.855628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6d1ff223-abb4-4bf9-ba65-6ac34f30c51a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.153999 May 27 03:43:56.856190 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 492/977] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:56 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:57.872555 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:57.873173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:57.886096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:57.886096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:57.886096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:57.886096 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:58.013684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:58.021859 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-303fa12c-297b-4b03-abe5-20ef139f1213 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.153128 May 27 03:43:58.032167 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 486/978] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:57 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:59.040280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:59.040903 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:43:59.043310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:59.048164 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:59.048609 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:59.049367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:43:59.049855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:43:59.052383 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:59.182999 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:59.191767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-79e721ec-7bbb-4a29-be52-82b53f31ca05 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.155391 May 27 03:43:59.192334 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 493/979] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:43:59 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:00.209094 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:00.209633 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:00.212108 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:00.216816 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:00.217256 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:00.218522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:00.218983 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:00.222781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:00.354045 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:00.361762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f29fe20-10ca-4e7e-890a-95fa48f12b07 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.156836 May 27 03:44:00.362316 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 487/980] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:00 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:01.379358 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:01.379971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:01.386578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:01.387060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:01.387841 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:01.388278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:01.520373 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:01.527894 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-93f46618-fd22-469c-9326-5de57299d162 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.152895 May 27 03:44:01.528465 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 494/981] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:01 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:02.544958 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:02.546123 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:02.553592 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:02.554039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:02.554964 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:02.555574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:02.685216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:02.692971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-21387612-6c6a-44ca-9eda-46cd6e943186 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.152119 May 27 03:44:02.693576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 488/982] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:02 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:03.711021 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:03.711643 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:03.718747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:03.719179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:03.719940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:03.720382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:03.851369 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:03.859018 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ac689459-e9b4-47d0-bf52-c159339f1b4d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.152026 May 27 03:44:03.859591 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 495/983] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:03 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:04.875955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:04.876572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:04.883267 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:04.883724 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:04.884488 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:04.884928 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:05.010023 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:05.018059 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b68d6bb0-4f47-448e-8fa9-f8d056408248 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.145989 May 27 03:44:05.018627 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 489/984] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:04 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:06.036129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:06.036768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:06.043185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:06.043632 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:06.044428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:06.044869 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:06.173852 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:06.181412 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ed8887c5-f9e3-46b6-bd2d-01c831d0e993 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.149692 May 27 03:44:06.181978 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 496/985] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:06 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:06.775837 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:06.776326 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:06.782979 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:06.783431 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:06.784191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:06.784623 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:06.866152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lazy-loading 'services' on Instance uuid 637fee42-bec3-4b04-adac-b90160f3b41a {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:44:07.131568 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-be7c0767-fb50-4a06-91dc-7752d8ab4b74 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "DELETE /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a/os-volume_attachments/6f20ecd5-8e67-4d09-9c31-2d064a74f096" status: 202 len: 0 microversion: 2.1 time: 0.359425 May 27 03:44:07.132171 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 490/986] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:44:06 2022] DELETE /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a/os-volume_attachments/6f20ecd5-8e67-4d09-9c31-2d064a74f096 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:07.197987 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:07.198595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:07.205663 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:07.206107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:07.206878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:07.207316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:07.338038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:07.346877 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-21b7479d-a4bf-49f0-9fe1-3d722b9b032d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1676 microversion: 2.1 time: 0.152538 May 27 03:44:07.347489 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 497/987] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:07 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:08.365408 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:08.366106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:08.373006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:08.373451 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:08.374207 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:08.374642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:08.501594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:08.509040 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8614fc2d-eacf-4d9e-a3f4-3ac4668d9b39 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1653 microversion: 2.1 time: 0.148502 May 27 03:44:08.509598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 491/988] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:08 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1653 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:08.525832 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c04b24f8-9dd4-42dd-b9a3-43da0e8be1a5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:08.532931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c04b24f8-9dd4-42dd-b9a3-43da0e8be1a5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:08.533382 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c04b24f8-9dd4-42dd-b9a3-43da0e8be1a5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:08.592422 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c04b24f8-9dd4-42dd-b9a3-43da0e8be1a5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Going to try to start instance {{(pid=124770) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 03:44:08.751539 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c04b24f8-9dd4-42dd-b9a3-43da0e8be1a5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action" status: 202 len: 0 microversion: 2.1 time: 0.229261 May 27 03:44:08.752099 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 498/989] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 27 03:44:08 2022] POST /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:08.760008 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:08.760616 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:08.767107 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:08.767555 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:08.768299 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:08.768723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:08.897447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:08.904972 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-22ed56bd-a432-481b-9316-81a7696b203b tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1662 microversion: 2.1 time: 0.148725 May 27 03:44:08.905547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 492/990] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:08 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:09.923851 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:09.924540 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:09.930712 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:09.931187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:09.932063 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:09.932485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:10.058315 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:10.066763 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9e3b01e9-d795-4fba-9525-7f867c23fc82 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1662 microversion: 2.1 time: 0.148215 May 27 03:44:10.067364 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 499/991] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:09 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:11.086101 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:11.086101 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:11.091503 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:11.091957 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:11.092723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:11.093165 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:11.225264 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:11.232891 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3b49c912-6c4b-4831-88a3-73f0fd9ec992 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1662 microversion: 2.1 time: 0.152553 May 27 03:44:11.233462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 493/992] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:11 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:11.428470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:11.428913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:11.435475 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:11.435929 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:11.436693 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:11.437128 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:11.465268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:44:11.766004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1f29686b-d5f1-4c85-8d4a-3c44a7f4ed1a tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "DELETE /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 204 len: 0 microversion: 2.1 time: 0.340961 May 27 03:44:11.767120 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 500/993] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:44:11 2022] DELETE /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:44:11.775258 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:11.775902 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:11.781842 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:11.782910 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:11.783673 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:11.784125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:11.917843 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:11.925619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b67759d2-2fc6-4581-9cda-35fcbb1f4750 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1514 microversion: 2.1 time: 0.154210 May 27 03:44:11.926191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 494/994] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:11 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:12.252401 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:12.253093 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:12.259789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:12.260234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:12.260982 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:12.261479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:12.391096 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:12.398659 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4b9794bc-4e29-4160-aae4-4244996899c2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1666 microversion: 2.1 time: 0.151512 May 27 03:44:12.399264 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 501/995] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:12 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:12.943737 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:12.944357 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:12.950956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:12.951409 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:12.952173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:12.952612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:13.090423 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:13.100781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6006fa1b-255d-448a-b1a9-b6e9125b6384 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1514 microversion: 2.1 time: 0.158045 May 27 03:44:13.100781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 495/996] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:12 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:13.938577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-8d8e6ca6-b987-4db0-a187-2e64f3899bae req-1f8baba9-f5d5-4e02-8c20-1326069de846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637fee42-bec3-4b04-adac-b90160f3b41a", "name": "network-vif-deleted", "tag": "455a2f6f-8f96-4c46-8788-171155ad5030"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:13.947326 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-8d8e6ca6-b987-4db0-a187-2e64f3899bae req-1f8baba9-f5d5-4e02-8c20-1326069de846 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:13.955144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-8d8e6ca6-b987-4db0-a187-2e64f3899bae req-1f8baba9-f5d5-4e02-8c20-1326069de846 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:13.959388 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-8d8e6ca6-b987-4db0-a187-2e64f3899bae req-1f8baba9-f5d5-4e02-8c20-1326069de846 service nova] Creating event network-vif-deleted:455a2f6f-8f96-4c46-8788-171155ad5030 for instance 637fee42-bec3-4b04-adac-b90160f3b41a on hv-cinder-82880 May 27 03:44:13.964518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-8d8e6ca6-b987-4db0-a187-2e64f3899bae req-1f8baba9-f5d5-4e02-8c20-1326069de846 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029572 May 27 03:44:13.965199 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 502/997] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:14.116226 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:14.116753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:14.123237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:14.123694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:14.124444 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:14.124876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:14.191613 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:14.199090 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8017e486-a6ab-4fdf-b8c8-79ceeafa5034 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 200 len: 1304 microversion: 2.1 time: 0.086804 May 27 03:44:14.209668 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 496/998] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:14 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:15.220483 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:15.221179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: 637fee42-bec3-4b04-adac-b90160f3b41a] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:15.229485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:15.229485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:15.229485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:15.229485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:15.243588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] HTTP exception thrown: Instance 637fee42-bec3-4b04-adac-b90160f3b41a could not be found. May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Request method failure captured: May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a HTTP/1.1 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEjF_10PfhFlGoe9C9vgYfaGt01biQz-GllY6q5Srwv86qZoCv_9CkwAH2JmAtH0LZnrBlm4dY69Ge3-ozDqP6AAh9N7wZLfZhs3f-iB8LvWqy2Bjdv4tP55EF4GPRuiJPL6j4PXdaLbn9P8Jv3m4urSUxTcsxFv-IXp_yxJAY85Fl0 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 245626825e3b480485223cd0e3d54580 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotTestJSON-565840811 May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:44:15.245218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_245626825e3b480485223cd0e3d54580", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/245626825e3b480485223cd0e3d54580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/245626825e3b480485223cd0e3d54580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/245626825e3b480485223cd0e3d54580"}]}] May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotTestJSON-565840811 May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 245626825e3b480485223cd0e3d54580 May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-565840811 May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotTestJSON-565840811-project May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 1e33fbb258684a00a7a8d948d92a8c01 May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotTestJSON-565840811-project May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 637fee42-bec3-4b04-adac-b90160f3b41a could not be found. May 27 03:44:15.246821 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '637fee42-bec3-4b04-adac-b90160f3b41a'} May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637fee42-bec3-4b04-adac-b90160f3b41a could not be found. May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:44:15.247883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637fee42-bec3-4b04-adac-b90160f3b41a could not be found. May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637fee42-bec3-4b04-adac-b90160f3b41a could not be found. May 27 03:44:15.249440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:44:15.250748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Returning 404 to user: Instance 637fee42-bec3-4b04-adac-b90160f3b41a could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:44:15.250748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-97a0a472-76ec-40d3-bfea-a54c226482c8 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a" status: 404 len: 111 microversion: 2.1 time: 0.030910 May 27 03:44:15.250748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 503/999] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:15 2022] GET /compute/v2.1/servers/637fee42-bec3-4b04-adac-b90160f3b41a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:23.709906 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-185031970", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "networks": [{"uuid": "957f92df-3f90-4ab3-b244-3c908e00f069"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:23.760589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] validate_networks() for [('957f92df-3f90-4ab3-b244-3c908e00f069', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:44:24.095332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:44:24.095758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:44:24.096233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:44:24.096674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:44:24.097087 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:44:24.106426 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:24.106901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:24.107696 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:24.108132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:24.125765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Getting quotas for project 245626825e3b480485223cd0e3d54580. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:44:24.129647 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Getting quotas for user 1e33fbb258684a00a7a8d948d92a8c01 and project 245626825e3b480485223cd0e3d54580. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:44:24.140436 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:44:24.142644 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:44:24.275705 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-04cd49d4-6efb-45af-91c3-953dd0d15eac tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569888 May 27 03:44:24.276345 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 497/1000] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:44:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:44:24.286214 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52d019dc-93cc-4509-bc0f-95197c9bfac9 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:24.287584 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52d019dc-93cc-4509-bc0f-95197c9bfac9 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:24.339891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52d019dc-93cc-4509-bc0f-95197c9bfac9 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:24.346679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52d019dc-93cc-4509-bc0f-95197c9bfac9 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1218 microversion: 2.1 time: 0.064413 May 27 03:44:24.347354 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 504/1001] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:24 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:25.364472 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:25.365047 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:25.371134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:25.371585 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:25.372338 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:25.372773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:25.433244 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:25.441850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fcda10ee-f90f-4a8e-b5ff-2592bfc9d071 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1222 microversion: 2.1 time: 0.080973 May 27 03:44:25.442487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 498/1002] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:25 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:26.460140 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:26.460693 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:26.463646 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:26.467737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:26.468186 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:26.470325 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:26.470325 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:26.533922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:26.542226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-dcd2eb47-2ca0-425d-9b98-2dd814c482cb tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1278 microversion: 2.1 time: 0.086997 May 27 03:44:26.542794 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 505/1003] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:26 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:27.559237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:27.559872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:27.566439 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:27.567011 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:27.567779 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:27.568216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:27.700605 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:27.708781 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fd6a999d-16d8-4924-a902-a2d92f85ec4f tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.153522 May 27 03:44:27.709629 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 499/1004] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:27 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:28.167171 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-d189aa94-a375-42e6-a965-5a0fcf360b36 req-8f2760ef-a396-4b8b-aa98-62202fd0f2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeda820f-c51e-4a91-8266-d60772560f11", "tag": "9cb090d1-9ae2-491f-99a4-e61eac31db73"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:28.177057 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d189aa94-a375-42e6-a965-5a0fcf360b36 req-8f2760ef-a396-4b8b-aa98-62202fd0f2b7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:28.177579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d189aa94-a375-42e6-a965-5a0fcf360b36 req-8f2760ef-a396-4b8b-aa98-62202fd0f2b7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:28.188872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-d189aa94-a375-42e6-a965-5a0fcf360b36 req-8f2760ef-a396-4b8b-aa98-62202fd0f2b7 service nova] Creating event network-changed:9cb090d1-9ae2-491f-99a4-e61eac31db73 for instance eeda820f-c51e-4a91-8266-d60772560f11 on hv-cinder-82880 May 27 03:44:28.193713 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-d189aa94-a375-42e6-a965-5a0fcf360b36 req-8f2760ef-a396-4b8b-aa98-62202fd0f2b7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030334 May 27 03:44:28.194310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 506/1005] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:28.725581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:28.726187 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:28.733164 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:28.733609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:28.734576 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:28.735090 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:28.878502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:28.878502 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4fc5359e-9047-4c6b-9e03-8adc7b157e15 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.156742 May 27 03:44:28.878916 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 500/1006] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:28 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:29.896473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:29.897182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:29.899967 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:29.904974 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:29.905522 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:29.906288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:29.906727 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:30.032224 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:30.041590 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4c996328-4337-4177-b882-b8660083757b tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.149386 May 27 03:44:30.042626 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 507/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:29 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:31.058512 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:31.059220 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:31.061600 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:31.066550 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:31.067039 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:31.067831 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:31.068270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:31.196566 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:31.204051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b422e2a0-92f9-436c-868e-f49ea0e6ba93 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.149459 May 27 03:44:31.208383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 501/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:31 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:32.221574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:32.222115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:32.228675 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:32.229122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:32.229873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:32.230302 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:32.364860 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:32.373479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d0d6dd31-0a84-472a-8836-511c70bd2f50 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.155562 May 27 03:44:32.378961 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 508/1009] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:32 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:32.821041 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-1ebc1469-1fa0-4a65-b7df-c17776c7c1a8 req-934f5462-c12a-4ebc-bc5d-2939805fb90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeda820f-c51e-4a91-8266-d60772560f11", "name": "network-vif-plugged", "status": "completed", "tag": "9cb090d1-9ae2-491f-99a4-e61eac31db73"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:32.829813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-1ebc1469-1fa0-4a65-b7df-c17776c7c1a8 req-934f5462-c12a-4ebc-bc5d-2939805fb90e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:32.830178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-1ebc1469-1fa0-4a65-b7df-c17776c7c1a8 req-934f5462-c12a-4ebc-bc5d-2939805fb90e service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:32.833790 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:32.841209 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-1ebc1469-1fa0-4a65-b7df-c17776c7c1a8 req-934f5462-c12a-4ebc-bc5d-2939805fb90e service nova] Creating event network-vif-plugged:9cb090d1-9ae2-491f-99a4-e61eac31db73 for instance eeda820f-c51e-4a91-8266-d60772560f11 on hv-cinder-82880 May 27 03:44:32.846337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-1ebc1469-1fa0-4a65-b7df-c17776c7c1a8 req-934f5462-c12a-4ebc-bc5d-2939805fb90e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028881 May 27 03:44:32.846944 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 502/1010] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:33.390938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:33.391545 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:33.398529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:33.399006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:33.399762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:33.400198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:33.525387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:33.533017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-61ca552e-889b-45fb-a9d8-1d1740e55fc3 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.145975 May 27 03:44:33.533581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 509/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:33 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:34.547411 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:34.548161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:34.552452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:34.554462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:34.559726 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:34.560181 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:34.560938 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:34.561378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:34.692734 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:34.701113 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fe4a815b-bac5-40aa-8064-63801a3c73e7 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1318 microversion: 2.1 time: 0.155115 May 27 03:44:34.701898 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 503/1012] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:34 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:35.717192 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:35.717795 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:35.719692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:35.725268 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:35.725739 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:35.726537 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:35.727015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:35.853743 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:35.861344 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6af6ab3c-58e4-438a-b8a6-0a49514a39d2 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1507 microversion: 2.1 time: 0.148030 May 27 03:44:35.862074 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 510/1013] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:35 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:35.877881 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31dbad2b-32a5-4768-affe-2addb3842b24", "device": "/dev/sdb"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:35.879517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:35.886557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:35.887072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:35.887820 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:35.888261 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:36.689241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d6d3104f-84eb-42b1-9354-5118e7bb1610 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "POST /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815030 May 27 03:44:36.689855 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 504/1014] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:44:35 2022] POST /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:45.185579 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:45.186501 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:45.193770 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:45.194215 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:45.195000 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:45.195435 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:45.223775 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-92119da9-cf09-45a8-a10d-1d63187e83ce tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042193 May 27 03:44:45.224367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 511/1015] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:44:45 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:44:45.281666 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:45.282250 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:45.289328 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:45.289777 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:45.290574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:45.291052 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:45.316189 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:44:45.581230 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fb89570c-d345-49e1-9a57-9e4c2bc8227a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 204 len: 0 microversion: 2.1 time: 0.303430 May 27 03:44:45.581866 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 505/1016] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:44:45 2022] DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:44:45.590169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:45.590790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:45.598330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:45.598330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:45.598330 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:45.598862 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:45.723461 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:45.731487 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-10d9a96e-dc1f-4133-9fa1-0728eb29929d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.145262 May 27 03:44:45.732058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 512/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:45 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:46.749021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:46.749712 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:46.756730 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:46.757174 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:46.757925 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:46.758353 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:46.890218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:46.897848 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-719005a8-b090-4331-8828-8c0957ff4665 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.153037 May 27 03:44:46.898416 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 506/1018] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:46 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:47.915281 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:47.915820 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:47.921938 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:47.922387 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:47.923182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:47.923622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:48.048613 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:48.056454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-60e308cd-f35e-43f5-bea9-974d228352a3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.145219 May 27 03:44:48.060048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 513/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:47 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:49.073919 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:49.074536 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:49.081199 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:49.081657 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:49.082422 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:49.082885 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:49.220083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:49.228251 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cb3b8fe4-3e57-49af-910b-597b01827edf tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.158283 May 27 03:44:49.228828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 507/1020] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:49 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:50.245576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:50.246182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:50.252898 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:50.253350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:50.254108 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:50.254543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:50.379578 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:50.387664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-786f7c57-a016-4295-ae89-e90955c7c3aa tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.146019 May 27 03:44:50.388251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 514/1021] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:50 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:51.404849 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:51.405425 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:51.411787 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:51.412228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:51.413591 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:51.414021 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:51.562704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:51.570936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd33b243-be58-4ca7-9015-c7edbf63c4dd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.169954 May 27 03:44:51.571515 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 508/1022] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:51 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:52.588474 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:52.589084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:52.595543 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:52.595992 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:52.596748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:52.597179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:52.727189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:52.734783 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ad491b1e-fd6d-44fd-8736-af07b051e4d1 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1672 microversion: 2.1 time: 0.150533 May 27 03:44:52.735470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 515/1023] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:52 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:53.227901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6ee5452d-0656-4953-af6f-0c49cef4abaa req-a8e41b79-221a-4ed5-9288-aebd1909582d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a65177-fd0d-4c44-a70a-d285315c23ee", "name": "network-vif-deleted", "tag": "0c05523a-7a76-4594-a966-ad04b22c87e0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:53.237042 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6ee5452d-0656-4953-af6f-0c49cef4abaa req-a8e41b79-221a-4ed5-9288-aebd1909582d service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:53.237471 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6ee5452d-0656-4953-af6f-0c49cef4abaa req-a8e41b79-221a-4ed5-9288-aebd1909582d service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:53.249188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6ee5452d-0656-4953-af6f-0c49cef4abaa req-a8e41b79-221a-4ed5-9288-aebd1909582d service nova] Creating event network-vif-deleted:0c05523a-7a76-4594-a966-ad04b22c87e0 for instance 87a65177-fd0d-4c44-a70a-d285315c23ee on hv-cinder-82880 May 27 03:44:53.254023 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6ee5452d-0656-4953-af6f-0c49cef4abaa req-a8e41b79-221a-4ed5-9288-aebd1909582d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030427 May 27 03:44:53.254620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 509/1024] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:53.753242 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:53.753807 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:53.761278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:53.761737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:53.762580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:53.763067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:53.798959 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:53.799422 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:53.799879 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lazy-loading 'fault' on Instance uuid 87a65177-fd0d-4c44-a70a-d285315c23ee {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:44:53.843865 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:53.851981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-bfbf2a9b-fd3a-4dab-b61f-b1e7c9eee023 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 200 len: 1327 microversion: 2.1 time: 0.102908 May 27 03:44:53.852561 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 516/1025] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:53 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:54.870435 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:54.871072 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:54.877359 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:54.877804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:54.878558 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:54.879022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:54.892856 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] HTTP exception thrown: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Request method failure captured: May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee HTTP/1.1 May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEh3F5w2AdqEjdouEZfNCAnB29DE_rivbmgwmtetbNaNcCv5DNIuRFNIdE3MFkd4sWZDgKD8NKlZDZ-B5_sg5-JYtStm6bby7ceHC_E1JpP1pm4CVfJRMa9ijcmBXo92CaESi97BzNx621mubZU0JnSnbDmJ71LSagWILpfrkrPDetU May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:44:54.894450 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_37f34daf6ac94c41b23e1bc899ab671f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/37f34daf6ac94c41b23e1bc899ab671f"}]}] May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1776627733 May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 2e4436dc550a44269ffbd4760670f551 May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:44:54.896152 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '87a65177-fd0d-4c44-a70a-d285315c23ee'} May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:44:54.897006 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:44:54.898485 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:44:54.899920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Returning 404 to user: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:44:54.899920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-502cf9a2-e8e8-4843-90ca-993339e72f08 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 404 len: 111 microversion: 2.1 time: 0.030908 May 27 03:44:54.899920 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 510/1026] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:54 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:44:54.904638 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4ad685ed-8bc4-488d-9bc0-b8e25ffed4e4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '.version_select at 0x7f30467e3a60>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:54.988741 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4ad685ed-8bc4-488d-9bc0-b8e25ffed4e4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127119134" status: 202 len: 0 microversion: 2.1 time: 0.087748 May 27 03:44:54.989343 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 517/1027] 10.222.0.24 () {58 vars in 1220 bytes} [Fri May 27 03:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127119134 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:44:55.816383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2f1967d5-fbb2-4b90-ae50-2bbb717c79f9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: .version_select at 0x7f3046ab6550>, body: {"keypair": {"name": "tempest-keypair-1401779648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/hewc8opZ+dwwes20r5701So3V9prcjaWUE8G8WiZX4RDrToeYfGbxmQcnYtiiLYmeNkRW7oNk5RQqc8KryHvZXHTwyVOH14Vy1Tg3DNZ854arsZM7q3COF0Vpw9KxqQ=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:55.831577 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-2f1967d5-fbb2-4b90-ae50-2bbb717c79f9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:44:55.835857 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-2f1967d5-fbb2-4b90-ae50-2bbb717c79f9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for user 2e4436dc550a44269ffbd4760670f551 and project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:44:55.966604 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2f1967d5-fbb2-4b90-ae50-2bbb717c79f9 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154103 May 27 03:44:55.967287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 511/1028] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:44:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:56.752450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:56.758963 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:56.760471 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:56.761008 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:56.761850 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:56.762360 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:56.842041 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lazy-loading 'services' on Instance uuid eeda820f-c51e-4a91-8266-d60772560f11 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:44:57.142251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-15312fc0-c39e-4c01-9feb-0a1873721463 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11/os-volume_attachments/31dbad2b-32a5-4768-affe-2addb3842b24" status: 202 len: 0 microversion: 2.1 time: 0.393504 May 27 03:44:57.142791 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 518/1029] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:44:56 2022] DELETE /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11/os-volume_attachments/31dbad2b-32a5-4768-affe-2addb3842b24 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:58.176986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-451044753", "imageRef": "4d321cb9-5e87-4890-b37e-4deb082f103f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d90c714-9bd8-40b9-8a54-714767000c3f"}], "security_groups": [{"name": "tempest-securitygroup--456168243"}], "key_name": "tempest-keypair-1401779648", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:58.256644 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:58.257321 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:58.264707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:58.265365 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:58.266172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:58.266629 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:58.285633 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] validate_networks() for [('9d90c714-9bd8-40b9-8a54-714767000c3f', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:44:58.293360 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:44:58.531342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-00f98231-698f-4cd5-a5c3-c0e158e8bfb1 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 204 len: 0 microversion: 2.1 time: 0.278813 May 27 03:44:58.532070 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 519/1030] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:44:58 2022] DELETE /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:44:58.540867 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:58.541571 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:58.547702 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:58.548158 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:58.548927 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:58.549370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:58.569649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:58.710569 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:44:58.711132 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:44:58.711682 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:44:58.712222 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:44:58.712768 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:44:58.721670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:58.722125 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:58.722958 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:58.723398 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:58.733530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:58.742113 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6d1ca8c6-96bf-412e-bb43-b566a8a05b4e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1513 microversion: 2.1 time: 0.205549 May 27 03:44:58.743366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 520/1031] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:58 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:58.750279 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:44:58.752497 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Getting quotas for user 2e4436dc550a44269ffbd4760670f551 and project 37f34daf6ac94c41b23e1bc899ab671f. Resources: {'instances', 'cores', 'ram'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:44:58.764103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:44:58.766372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d321cb9-5e87-4890-b37e-4deb082f103f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:44:58.921183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f806a703-04ac-414e-8f79-f4087a2933a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.748808 May 27 03:44:58.921770 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 512/1032] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:44:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:44:58.932295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-87fc5c33-8a10-4caa-b817-7a69385c608d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:58.932908 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-87fc5c33-8a10-4caa-b817-7a69385c608d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:58.987608 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-87fc5c33-8a10-4caa-b817-7a69385c608d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:58.995237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-87fc5c33-8a10-4caa-b817-7a69385c608d tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1237 microversion: 2.1 time: 0.067154 May 27 03:44:58.995649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 521/1033] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:58 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:59.760850 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:59.761437 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:44:59.768197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:59.768642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:59.769394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:44:59.769821 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:44:59.892177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:59.900205 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-737bf20d-dcf1-4cfd-95ab-520446e93618 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1513 microversion: 2.1 time: 0.144377 May 27 03:44:59.900779 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 513/1034] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:44:59 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:00.012902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:00.013447 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:00.015729 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:00.021749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:00.022204 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:00.022997 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:00.023440 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:00.089300 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:00.097081 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4bdda378-7ea5-48f1-ac4f-01d5ae7648d8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1241 microversion: 2.1 time: 0.088128 May 27 03:45:00.097636 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 522/1035] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:00 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:00.917173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:00.918013 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:00.925016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:00.925733 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:00.926507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:00.927154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:01.075960 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.084652 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4c6fddbe-78be-4abf-b635-23b5f0a8dc4c tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1513 microversion: 2.1 time: 0.171613 May 27 03:45:01.085619 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 514/1036] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:00 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:01.114310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:01.115157 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:01.122612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:01.123107 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:01.123893 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:01.124331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:01.196342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.204070 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-adc795c8-f698-4071-849c-2ea2a2e8b2a8 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1307 microversion: 2.1 time: 0.094263 May 27 03:45:01.204662 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 523/1037] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:01 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:01.469858 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-26160e78-b484-494c-876a-ce2ce28ceb58 req-91975ad0-5b09-4254-a3f4-b3300d3298f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeda820f-c51e-4a91-8266-d60772560f11", "name": "network-vif-deleted", "tag": "9cb090d1-9ae2-491f-99a4-e61eac31db73"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:01.473631 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:01.479453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-26160e78-b484-494c-876a-ce2ce28ceb58 req-91975ad0-5b09-4254-a3f4-b3300d3298f1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:01.479897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-26160e78-b484-494c-876a-ce2ce28ceb58 req-91975ad0-5b09-4254-a3f4-b3300d3298f1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:01.491103 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-26160e78-b484-494c-876a-ce2ce28ceb58 req-91975ad0-5b09-4254-a3f4-b3300d3298f1 service nova] Creating event network-vif-deleted:9cb090d1-9ae2-491f-99a4-e61eac31db73 for instance eeda820f-c51e-4a91-8266-d60772560f11 on hv-cinder-82880 May 27 03:45:01.496826 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-26160e78-b484-494c-876a-ce2ce28ceb58 req-91975ad0-5b09-4254-a3f4-b3300d3298f1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 May 27 03:45:01.497496 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 515/1038] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:02.101710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:02.102670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:02.109090 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:02.109533 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:02.110316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:02.110949 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:02.144891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:02.144891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:02.144891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lazy-loading 'fault' on Instance uuid eeda820f-c51e-4a91-8266-d60772560f11 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:45:02.219983 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e33fbb258684a00a7a8d948d92a8c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245626825e3b480485223cd0e3d54580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:02.222804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:02.224560 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:02.228473 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f88ad539-2bc9-4326-85ae-ad448d156927 tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 200 len: 1308 microversion: 2.1 time: 0.130557 May 27 03:45:02.229006 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 524/1039] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:02 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:02.236428 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:02.237128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:02.238670 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:02.239595 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:02.382457 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:02.391473 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75ee0425-4c5a-466f-9fe0-57b2d5632977 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.173689 May 27 03:45:02.395022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 516/1040] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:02 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:03.245730 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:03.246355 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] [instance: eeda820f-c51e-4a91-8266-d60772560f11] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:03.253128 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:03.253907 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:03.254557 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:03.255056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:03.269175 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] HTTP exception thrown: Instance eeda820f-c51e-4a91-8266-d60772560f11 could not be found. May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Request method failure captured: May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 HTTP/1.1 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEjF_10PfhFlGoe9C9vgYfaGt01biQz-GllY6q5Srwv86qZoCv_9CkwAH2JmAtH0LZnrBlm4dY69Ge3-ozDqP6AAh9N7wZLfZhs3f-iB8LvWqy2Bjdv4tP55EF4GPRuiJPL6j4PXdaLbn9P8Jv3m4urSUxTcsxFv-IXp_yxJAY85Fl0 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 245626825e3b480485223cd0e3d54580 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-VolumesSnapshotTestJSON-565840811 May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:45:03.270854 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_245626825e3b480485223cd0e3d54580", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/245626825e3b480485223cd0e3d54580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/245626825e3b480485223cd0e3d54580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/245626825e3b480485223cd0e3d54580"}]}] May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-VolumesSnapshotTestJSON-565840811 May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 245626825e3b480485223cd0e3d54580 May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-565840811 May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-VolumesSnapshotTestJSON-565840811-project May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 1e33fbb258684a00a7a8d948d92a8c01 May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-VolumesSnapshotTestJSON-565840811-project May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance eeda820f-c51e-4a91-8266-d60772560f11 could not be found. May 27 03:45:03.272454 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'eeda820f-c51e-4a91-8266-d60772560f11'} May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeda820f-c51e-4a91-8266-d60772560f11 could not be found. May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:45:03.273231 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeda820f-c51e-4a91-8266-d60772560f11 could not be found. May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeda820f-c51e-4a91-8266-d60772560f11 could not be found. May 27 03:45:03.275048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:45:03.276111 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] Returning 404 to user: Instance eeda820f-c51e-4a91-8266-d60772560f11 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:45:03.276111 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9637f73e-42d1-44e5-9f8e-63f67f1b8c6e tempest-VolumesSnapshotTestJSON-565840811 tempest-VolumesSnapshotTestJSON-565840811-project] 10.222.0.24 "GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11" status: 404 len: 111 microversion: 2.1 time: 0.030485 May 27 03:45:03.276866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 525/1041] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:03 2022] GET /compute/v2.1/servers/eeda820f-c51e-4a91-8266-d60772560f11 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:45:03.407796 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:03.408999 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:03.416043 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:03.416498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:03.417306 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:03.417723 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:03.519112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-51afdb54-9aac-4398-9442-d00126210469 req-c7f8315a-14aa-4945-8211-749722eaadc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69975da9-8b11-44ba-b542-a0e3ade18265", "tag": "ab55f18d-4961-4672-bb0a-e1ff6975f8a0"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:03.527901 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-51afdb54-9aac-4398-9442-d00126210469 req-c7f8315a-14aa-4945-8211-749722eaadc1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:03.528366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-51afdb54-9aac-4398-9442-d00126210469 req-c7f8315a-14aa-4945-8211-749722eaadc1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:03.539492 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-51afdb54-9aac-4398-9442-d00126210469 req-c7f8315a-14aa-4945-8211-749722eaadc1 service nova] Creating event network-changed:ab55f18d-4961-4672-bb0a-e1ff6975f8a0 for instance 69975da9-8b11-44ba-b542-a0e3ade18265 on hv-cinder-82880 May 27 03:45:03.544733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-51afdb54-9aac-4398-9442-d00126210469 req-c7f8315a-14aa-4945-8211-749722eaadc1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029253 May 27 03:45:03.546122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 526/1042] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:45:03.548030 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.556016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c6134470-f14e-4abe-b13f-dcbea89a0a46 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.151958 May 27 03:45:03.566305 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 517/1043] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:03 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:04.574475 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:04.575200 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:04.581436 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:04.586774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:04.586774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:04.586774 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:04.714888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:04.722582 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9169fe95-27d2-47b5-9a80-d8f49977beb7 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.152944 May 27 03:45:04.723276 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 527/1044] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:04 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:05.740473 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:05.741134 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:05.748363 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:05.748818 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:05.749584 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:05.750023 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:05.754052 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:05.876838 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:05.884188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-457b0978-421f-4a1d-8d57-7463b33a50ca tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.147601 May 27 03:45:05.884756 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 518/1045] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:05 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:06.901675 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:06.902198 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:06.908858 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:06.909312 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:06.910083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:06.910523 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:07.037630 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:07.045649 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6958c42d-1cca-49da-8e62-7287dd801067 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.148525 May 27 03:45:07.046219 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 528/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:06 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:08.062425 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:08.063064 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:08.069878 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:08.070330 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:08.071117 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:08.071550 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:08.371555 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:08.379717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-de66dc6d-59fc-4289-b2e4-4145a13a8e4a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.321301 May 27 03:45:08.380378 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 519/1047] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:08 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:09.396762 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:09.397408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:09.402029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:09.405138 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:09.405685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:09.406481 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:09.406952 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:09.418525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-9e8bd6b5-e1cf-4b35-8c9c-2f5e6b600ed1 req-9113e277-e446-4d43-820c-dcd7130d60c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69975da9-8b11-44ba-b542-a0e3ade18265", "name": "network-vif-plugged", "status": "completed", "tag": "ab55f18d-4961-4672-bb0a-e1ff6975f8a0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:09.424102 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:09.424876 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=10 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:09.429407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9e8bd6b5-e1cf-4b35-8c9c-2f5e6b600ed1 req-9113e277-e446-4d43-820c-dcd7130d60c5 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:09.430573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9e8bd6b5-e1cf-4b35-8c9c-2f5e6b600ed1 req-9113e277-e446-4d43-820c-dcd7130d60c5 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:09.441951 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-9e8bd6b5-e1cf-4b35-8c9c-2f5e6b600ed1 req-9113e277-e446-4d43-820c-dcd7130d60c5 service nova] Creating event network-vif-plugged:ab55f18d-4961-4672-bb0a-e1ff6975f8a0 for instance 69975da9-8b11-44ba-b542-a0e3ade18265 on hv-cinder-82880 May 27 03:45:09.447573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-9e8bd6b5-e1cf-4b35-8c9c-2f5e6b600ed1 req-9113e277-e446-4d43-820c-dcd7130d60c5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032237 May 27 03:45:09.448262 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 520/1048] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:45:09.598094 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:09.605605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ed06cf6c-4c36-4fdd-8ffc-a173279618b3 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.212728 May 27 03:45:09.606201 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 529/1049] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:09 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:10.624028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:10.624780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:10.631860 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:10.632308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:10.633060 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:10.633493 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:10.767248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:10.774679 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d0de40db-e72f-4bab-b72b-5cefa53cddde tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1362 microversion: 2.1 time: 0.155617 May 27 03:45:10.775864 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 521/1050] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:10 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:11.792429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:11.793067 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:11.799709 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:11.800163 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:11.800933 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:11.801381 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:11.927940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:11.938115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3d38c3ac-acb4-48e5-901c-8fa7e12caca2 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1548 microversion: 2.1 time: 0.149880 May 27 03:45:11.939233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 530/1051] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:45:11 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:11.962559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:11.963110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:11.969506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:11.969955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:11.970714 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:11.971183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:12.052220 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c5b40235-bea3-4ea7-b6de-378ba175b8a4 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093706 May 27 03:45:12.052853 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 522/1052] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 27 03:45:11 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:13.026172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-ce2d71f4-89b7-4e18-afba-1e01415d134b req-9c7ff9e1-b86f-43a3-a42d-99e85f3439ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69975da9-8b11-44ba-b542-a0e3ade18265", "tag": "ab55f18d-4961-4672-bb0a-e1ff6975f8a0"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:13.034769 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ce2d71f4-89b7-4e18-afba-1e01415d134b req-9c7ff9e1-b86f-43a3-a42d-99e85f3439ee service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:13.035251 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-ce2d71f4-89b7-4e18-afba-1e01415d134b req-9c7ff9e1-b86f-43a3-a42d-99e85f3439ee service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:13.048565 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-ce2d71f4-89b7-4e18-afba-1e01415d134b req-9c7ff9e1-b86f-43a3-a42d-99e85f3439ee service nova] Creating event network-changed:ab55f18d-4961-4672-bb0a-e1ff6975f8a0 for instance 69975da9-8b11-44ba-b542-a0e3ade18265 on hv-cinder-82880 May 27 03:45:13.053623 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-ce2d71f4-89b7-4e18-afba-1e01415d134b req-9c7ff9e1-b86f-43a3-a42d-99e85f3439ee service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031047 May 27 03:45:13.054228 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 531/1053] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:49.125777 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=15 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:49.126530 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=23 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:49.130365 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:49.130881 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:49.136773 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:49.137225 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:49.137986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:49.138419 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:49.162438 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a157371b-9737-4641-adbf-d8a16e182c9c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/ips" status: 200 len: 146 microversion: 2.1 time: 0.038257 May 27 03:45:49.163022 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 523/1054] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 27 03:45:49 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:50.785990 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=21 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:50.787556 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=52 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:50.792017 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e33440e-64d4-48d7-bf90-03b91b9a9555"}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:50.793170 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:50.799350 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:50.799803 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:50.803054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:50.803054 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:51.603165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3b8c0327-7657-41fb-9478-90d5a4ae022f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818850 May 27 03:45:51.603790 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 532/1055] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:45:50 2022] POST /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:59.092129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:59.093092 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:59.100472 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:59.100942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:59.101953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:59.102542 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:59.133848 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bbc58155-af19-4777-b532-a1dfc42c0e63 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046248 May 27 03:45:59.134394 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 524/1056] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:45:59 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:59.145404 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:59.145985 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:45:59.152213 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:59.152668 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:59.153430 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:45:59.153868 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:45:59.182363 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-716bc8d1-ba18-482e-a174-0cad4ad75352 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/5e33440e-64d4-48d7-bf90-03b91b9a9555" status: 200 len: 194 microversion: 2.1 time: 0.041907 May 27 03:45:59.182948 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 533/1057] 10.222.0.24 () {58 vars in 1412 bytes} [Fri May 27 03:45:59 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/5e33440e-64d4-48d7-bf90-03b91b9a9555 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:00.724527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38cc944f-c144-4aa1-8554-f084af34f35d"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:46:00.725598 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:00.732012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:00.732461 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:00.733218 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:00.733649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:01.469872 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b8e65afc-7421-417a-9921-4410bcc63a12 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "POST /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749070 May 27 03:46:01.470477 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 525/1058] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 27 03:46:00 2022] POST /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:08.954798 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:08.955747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:08.963246 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:08.963704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:08.964467 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:08.964904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:08.993884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-e685061e-33c8-49d9-8d3b-2d9d55914b24 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043084 May 27 03:46:08.994437 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 534/1059] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:46:08 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:09.137939 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:09.138563 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:09.144871 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:09.145319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:09.146105 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:09.146563 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:09.175864 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8a1ea68-ac5a-455f-a8e1-fd99295f5c01 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/5e33440e-64d4-48d7-bf90-03b91b9a9555" status: 200 len: 194 microversion: 2.1 time: 0.042630 May 27 03:46:09.177331 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 526/1060] 10.222.0.24 () {58 vars in 1412 bytes} [Fri May 27 03:46:09 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/5e33440e-64d4-48d7-bf90-03b91b9a9555 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:09.187152 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:09.187647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:09.194331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:09.194778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:09.195564 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:09.196005 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:09.274800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lazy-loading 'services' on Instance uuid 69975da9-8b11-44ba-b542-a0e3ade18265 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:46:09.488311 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a751f17f-f2e4-4115-a53d-72ecedeec3ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/5e33440e-64d4-48d7-bf90-03b91b9a9555" status: 202 len: 0 microversion: 2.1 time: 0.305053 May 27 03:46:09.489011 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 535/1061] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:46:09 2022] DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/5e33440e-64d4-48d7-bf90-03b91b9a9555 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:46:11.648348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:11.648875 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:11.655548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:11.656002 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:11.656870 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:11.657308 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:11.687197 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4d31e1f4-d1de-4bc5-a70f-7c8d417d007a tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/38cc944f-c144-4aa1-8554-f084af34f35d" status: 200 len: 194 microversion: 2.1 time: 0.042771 May 27 03:46:11.687780 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 527/1062] 10.222.0.24 () {58 vars in 1412 bytes} [Fri May 27 03:46:11 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/38cc944f-c144-4aa1-8554-f084af34f35d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:11.698726 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:11.699332 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:11.705686 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:11.706134 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:11.706911 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:11.707348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:11.787182 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lazy-loading 'services' on Instance uuid 69975da9-8b11-44ba-b542-a0e3ade18265 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:46:12.042801 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-010ab766-56cb-4b1c-841d-e683d37176e5 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/38cc944f-c144-4aa1-8554-f084af34f35d" status: 202 len: 0 microversion: 2.1 time: 0.348744 May 27 03:46:12.043420 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 536/1063] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 27 03:46:11 2022] DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments/38cc944f-c144-4aa1-8554-f084af34f35d => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:46:13.211675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:13.212648 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:13.219133 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.219578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.220327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.220753 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.250106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b7f6f58d-4d41-472d-882a-f739d13730ad tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051975 May 27 03:46:13.250657 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 528/1064] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:46:13 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:46:13.360030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:13.361102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:13.367943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.368399 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.369158 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.369598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.397124 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8e52463c-460b-4ac5-9514-9315d63d7643 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041935 May 27 03:46:13.397679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 537/1065] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 27 03:46:13 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:46:13.455337 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:13.458766 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:13.462206 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.462606 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.463395 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.463837 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.488900 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:46:13.797507 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ab37dee6-9fc0-43eb-8a2a-e693e154de2f tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 204 len: 0 microversion: 2.1 time: 0.345749 May 27 03:46:13.798121 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 529/1066] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:46:13 2022] DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:46:13.806172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:13.806881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:13.812945 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.813390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.814149 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:13.814581 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:13.940553 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:13.948599 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6586a051-51ff-48db-b821-c0a462c84297 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1673 microversion: 2.1 time: 0.146251 May 27 03:46:13.949400 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 538/1067] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:13 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:14.966816 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:14.967465 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:14.973956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:14.974936 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:14.975703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:14.976144 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:15.105016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:15.112555 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f09d728f-802e-46f0-a4d8-ab8e4fc6851c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1673 microversion: 2.1 time: 0.150082 May 27 03:46:15.113154 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 530/1068] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:14 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:16.129580 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:16.130303 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:16.137409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:16.137857 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:16.138610 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:16.139068 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:16.271083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:16.279117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-954e1fa4-dacb-4c83-97c5-0e06687e49ab tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1673 microversion: 2.1 time: 0.153330 May 27 03:46:16.280351 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 539/1069] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:16 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:46:16.871686 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-43f6e781-26bf-4b5a-b73b-b189a5ba9605 req-47af310a-0609-414b-a872-2203662ff373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69975da9-8b11-44ba-b542-a0e3ade18265", "name": "network-vif-deleted", "tag": "ab55f18d-4961-4672-bb0a-e1ff6975f8a0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:46:16.881833 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-43f6e781-26bf-4b5a-b73b-b189a5ba9605 req-47af310a-0609-414b-a872-2203662ff373 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:16.883978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-43f6e781-26bf-4b5a-b73b-b189a5ba9605 req-47af310a-0609-414b-a872-2203662ff373 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:16.896024 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-43f6e781-26bf-4b5a-b73b-b189a5ba9605 req-47af310a-0609-414b-a872-2203662ff373 service nova] Creating event network-vif-deleted:ab55f18d-4961-4672-bb0a-e1ff6975f8a0 for instance 69975da9-8b11-44ba-b542-a0e3ade18265 on hv-cinder-82880 May 27 03:46:16.902025 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-43f6e781-26bf-4b5a-b73b-b189a5ba9605 req-47af310a-0609-414b-a872-2203662ff373 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228715 May 27 03:46:16.907360 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 531/1070] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:17.303340 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:17.303937 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:17.311125 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:17.311595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:17.312367 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:17.312798 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:17.361615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:17.362075 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:17.362530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lazy-loading 'fault' on Instance uuid 69975da9-8b11-44ba-b542-a0e3ade18265 {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:46:17.404586 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4436dc550a44269ffbd4760670f551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f34daf6ac94c41b23e1bc899ab671f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:17.413390 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-992402dd-8628-41af-ba05-b2bce3c260a0 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 200 len: 1327 microversion: 2.1 time: 0.115070 May 27 03:46:17.415378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 540/1071] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:17 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:18.433877 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:18.434487 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:18.440766 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:18.441216 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:18.442005 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:18.442440 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:18.455589 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] HTTP exception thrown: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Request method failure captured: May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 HTTP/1.1 May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEh3F5w2AdqEjdouEZfNCAnB29DE_rivbmgwmtetbNaNcCv5DNIuRFNIdE3MFkd4sWZDgKD8NKlZDZ-B5_sg5-JYtStm6bby7ceHC_E1JpP1pm4CVfJRMa9ijcmBXo92CaESi97BzNx621mubZU0JnSnbDmJ71LSagWILpfrkrPDetU May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:46:18.457183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_37f34daf6ac94c41b23e1bc899ab671f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/37f34daf6ac94c41b23e1bc899ab671f"}]}] May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 2e4436dc550a44269ffbd4760670f551 May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:18.458946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '69975da9-8b11-44ba-b542-a0e3ade18265'} May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:46:18.460084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:18.461609 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:18.463056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Returning 404 to user: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:46:18.463056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0f3002f9-95fc-4ef4-a663-d10a29eb670e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 404 len: 111 microversion: 2.1 time: 0.029465 May 27 03:46:18.463056 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 532/1072] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:18 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:46:18.467729 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-8261bb51-8063-4244-81ba-2266fcb022bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '.version_select at 0x7f30468460d0>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:18.546891 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-8261bb51-8063-4244-81ba-2266fcb022bd tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401779648" status: 202 len: 0 microversion: 2.1 time: 0.082920 May 27 03:46:18.547521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 541/1073] 10.222.0.24 () {58 vars in 1220 bytes} [Fri May 27 03:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401779648 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:46:21.835656 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:21.837400 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:21.842852 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:21.843320 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:21.844079 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:21.844517 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:21.858630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] HTTP exception thrown: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Request method failure captured: May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 HTTP/1.1 May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEh3F5w2AdqEjdouEZfNCAnB29DE_rivbmgwmtetbNaNcCv5DNIuRFNIdE3MFkd4sWZDgKD8NKlZDZ-B5_sg5-JYtStm6bby7ceHC_E1JpP1pm4CVfJRMa9ijcmBXo92CaESi97BzNx621mubZU0JnSnbDmJ71LSagWILpfrkrPDetU May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:46:21.860182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_37f34daf6ac94c41b23e1bc899ab671f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/37f34daf6ac94c41b23e1bc899ab671f"}]}] May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 2e4436dc550a44269ffbd4760670f551 May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.861548 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '69975da9-8b11-44ba-b542-a0e3ade18265'} May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:46:21.862356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.863765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:21.865270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Returning 404 to user: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:46:21.865270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-958e0efb-b536-4cd4-837a-bec1705f563c tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 404 len: 111 microversion: 2.1 time: 0.030541 May 27 03:46:21.865270 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 533/1074] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:46:21 2022] DELETE /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:46:21.871295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:21.871913 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 69975da9-8b11-44ba-b542-a0e3ade18265] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:21.873889 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:46:21.879361 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:21.883255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:21.883255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:21.883255 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:21.885413 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:46:21.894685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] HTTP exception thrown: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Request method failure captured: May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 HTTP/1.1 May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEh3F5w2AdqEjdouEZfNCAnB29DE_rivbmgwmtetbNaNcCv5DNIuRFNIdE3MFkd4sWZDgKD8NKlZDZ-B5_sg5-JYtStm6bby7ceHC_E1JpP1pm4CVfJRMa9ijcmBXo92CaESi97BzNx621mubZU0JnSnbDmJ71LSagWILpfrkrPDetU May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:46:21.896339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_37f34daf6ac94c41b23e1bc899ab671f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/37f34daf6ac94c41b23e1bc899ab671f"}]}] May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 2e4436dc550a44269ffbd4760670f551 May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.897964 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '69975da9-8b11-44ba-b542-a0e3ade18265'} May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:46:21.898931 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. May 27 03:46:21.900345 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:21.901738 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Returning 404 to user: Instance 69975da9-8b11-44ba-b542-a0e3ade18265 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:46:21.901738 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-1b875b64-0e66-454e-8128-d0c0b0fe4285 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265" status: 404 len: 111 microversion: 2.1 time: 0.031119 May 27 03:46:21.901738 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 542/1075] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:21 2022] GET /compute/v2.1/servers/69975da9-8b11-44ba-b542-a0e3ade18265 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:46:23.166128 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:23.166660 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:23.173358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:23.173798 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:23.174581 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:23.175058 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:23.189126 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] HTTP exception thrown: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Request method failure captured: May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee HTTP/1.1 May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEh3F5w2AdqEjdouEZfNCAnB29DE_rivbmgwmtetbNaNcCv5DNIuRFNIdE3MFkd4sWZDgKD8NKlZDZ-B5_sg5-JYtStm6bby7ceHC_E1JpP1pm4CVfJRMa9ijcmBXo92CaESi97BzNx621mubZU0JnSnbDmJ71LSagWILpfrkrPDetU May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:46:23.190635 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_37f34daf6ac94c41b23e1bc899ab671f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/37f34daf6ac94c41b23e1bc899ab671f"}]}] May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: 2e4436dc550a44269ffbd4760670f551 May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.192304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '87a65177-fd0d-4c44-a70a-d285315c23ee'} May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:46:23.193166 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.194520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:46:23.195829 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Returning 404 to user: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:46:23.195829 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ce1c1cb7-6e77-41c5-a205-17cf07b80e70 tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 404 len: 111 microversion: 2.1 time: 0.030874 May 27 03:46:23.195829 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 534/1076] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:46:23 2022] DELETE /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:46:23.200839 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:23.201453 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] [instance: 87a65177-fd0d-4c44-a70a-d285315c23ee] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:46:23.208725 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:23.209176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:23.210234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:46:23.210675 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:46:23.223948 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] HTTP exception thrown: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Request method failure captured: May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee HTTP/1.1 May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEh3F5w2AdqEjdouEZfNCAnB29DE_rivbmgwmtetbNaNcCv5DNIuRFNIdE3MFkd4sWZDgKD8NKlZDZ-B5_sg5-JYtStm6bby7ceHC_E1JpP1pm4CVfJRMa9ijcmBXo92CaESi97BzNx621mubZU0JnSnbDmJ71LSagWILpfrkrPDetU May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:46:23.226112 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_37f34daf6ac94c41b23e1bc899ab671f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/37f34daf6ac94c41b23e1bc899ab671f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/37f34daf6ac94c41b23e1bc899ab671f"}]}] May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 37f34daf6ac94c41b23e1bc899ab671f May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1776627733 May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: 2e4436dc550a44269ffbd4760670f551 May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-AttachVolumeTestJSON-1776627733-project May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.227722 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '87a65177-fd0d-4c44-a70a-d285315c23ee'} May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:46:23.228587 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. May 27 03:46:23.230144 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:46:23.231485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] Returning 404 to user: Instance 87a65177-fd0d-4c44-a70a-d285315c23ee could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:46:23.231485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-12bd0e11-389e-4ce8-b448-d54def532f1e tempest-AttachVolumeTestJSON-1776627733 tempest-AttachVolumeTestJSON-1776627733-project] 10.222.0.24 "GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee" status: 404 len: 111 microversion: 2.1 time: 0.031149 May 27 03:46:23.231485 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 543/1077] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:46:23 2022] GET /compute/v2.1/servers/87a65177-fd0d-4c44-a70a-d285315c23ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:48:16.190353 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:16.191304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:16.397922 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2d6b4c6b-2dc4-467d-857c-fc4447608d76 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Action: 'create', calling method: .version_select at 0x7f304683cd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-549038653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcaIm1uC0S9aPZAS3yMRDiMautilDT4yHMoDRd3OmjwQVBbsRBPNsIxfvPDORLH+sq+1Fcil0GdW2GJLgdmNQbfUUkifMbd7zLz3TMERGhPTCyKOj0BBWqM5jGPTcXsmw=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:16.414188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-2d6b4c6b-2dc4-467d-857c-fc4447608d76 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for project 696d1db827244c65b179789b47baabe1. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:48:16.418530 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-2d6b4c6b-2dc4-467d-857c-fc4447608d76 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for user a98a71f87f4b49fbb98d068065edb1f6 and project 696d1db827244c65b179789b47baabe1. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:48:16.490304 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2d6b4c6b-2dc4-467d-857c-fc4447608d76 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.301566 May 27 03:48:16.491955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 535/1078] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 27 03:48:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:34.637240 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-144616501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-549038653", "security_groups": [{"name": "tempest-secgroup-smoke-1707052482"}], "block_device_mapping_v2": [{"uuid": "87b02003-724b-45a2-b94c-5d5a86669bc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3032795-d107-4737-b6eb-c559a5838bdb"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:34.750183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] validate_networks() for [('e3032795-d107-4737-b6eb-c559a5838bdb', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:48:35.210378 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:48:35.210793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:48:35.211285 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:48:35.211685 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:48:35.212087 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:48:35.222297 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:35.222742 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:35.223569 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:35.224004 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:35.240652 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for project 696d1db827244c65b179789b47baabe1. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:48:35.244484 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for user a98a71f87f4b49fbb98d068065edb1f6 and project 696d1db827244c65b179789b47baabe1. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:48:35.300940 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:48:35.303178 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87b02003-724b-45a2-b94c-5d5a86669bc0',volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:48:35.673956 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [60f5d6c6-1ce5-4cfd-888a-808eeaf03853] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:48:36.681479 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [60f5d6c6-1ce5-4cfd-888a-808eeaf03853] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 58784. May 27 03:48:36.685328 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ccb4c7a1-f60f-4f3d-b593-e30c989e939a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.053921 May 27 03:48:36.685977 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 544/1079] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:48:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:48:36.696031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e6cf86b2-ed89-439a-8dba-72a6644cc9aa tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:36.696650 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e6cf86b2-ed89-439a-8dba-72a6644cc9aa tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:36.699055 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:36.700065 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:36.753718 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e6cf86b2-ed89-439a-8dba-72a6644cc9aa tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:36.760447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e6cf86b2-ed89-439a-8dba-72a6644cc9aa tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1093 microversion: 2.1 time: 0.068253 May 27 03:48:36.761137 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 536/1080] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:36 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:37.778137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:37.778708 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:37.785124 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:37.785577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:37.789357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:37.789357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:37.846984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:37.854574 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-953d0266-fbc7-4f31-ab99-8d5eaf8bba57 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1143 microversion: 2.1 time: 0.080984 May 27 03:48:37.855218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 545/1081] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:37 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:38.478849 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:48:38.479056 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:48:38.871820 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:38.872917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:38.880370 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:38.880813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:38.881559 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:38.881986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:38.946327 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:38.954704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a672d5be-eb0f-4948-bfe4-94dc8ddd08b9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1191 microversion: 2.1 time: 0.086685 May 27 03:48:38.955301 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 537/1082] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:38 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:39.972800 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:39.974280 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:39.985218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:39.986196 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:39.987289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:39.987806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:40.137915 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:40.154606 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-eff0b65b-2c19-40bf-81f5-fc0210355d3c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1277 microversion: 2.1 time: 0.185619 May 27 03:48:40.155222 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 546/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:39 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:40.838805 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788423a8-d964-45c7-a881-d67ad880306b", "tag": "d0336d7e-69a4-4a30-8efc-dfa397dc0daf"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:40.847506 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:40.847953 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:40.863442 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] Creating event network-changed:d0336d7e-69a4-4a30-8efc-dfa397dc0daf for instance 788423a8-d964-45c7-a881-d67ad880306b on hv-cinder-82880 May 27 03:48:40.875175 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR oslo.messaging._drivers.impl_rabbit [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] [1827c535-0a96-4936-98d3-f6a8d3af0b48] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:48:41.172117 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:41.172724 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:41.179353 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:41.179807 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:41.180585 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:41.181020 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:41.313508 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:41.320855 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-337c8759-eae9-433a-bae7-ddd05070f8a2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.153153 May 27 03:48:41.321416 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 547/1084] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:41 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:48:41.874075 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] [1827c535-0a96-4936-98d3-f6a8d3af0b48] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 58814. May 27 03:48:41.877708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-d840b497-715d-4403-be93-70e534ff0dda req-86e6cb8e-e173-47c2-920d-db33bb2bff6b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042990 May 27 03:48:41.878317 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 538/1085] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:42.338053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:42.338665 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:42.345814 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:42.346461 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:42.347060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:42.347505 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:42.476656 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:42.484187 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5983be1a-5c31-493d-b2c1-e8d3d6e531cc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.150351 May 27 03:48:42.484750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 548/1086] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:42 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:43.503089 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:43.503671 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:43.510002 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:43.510454 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:43.520519 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:43.520519 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:43.639921 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:43.647611 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8c055389-49cf-43f9-8d07-5f0a2d00c434 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.149620 May 27 03:48:43.648182 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 539/1087] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:43 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:44.664514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:44.665162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:44.672062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:44.672515 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:44.673326 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:44.673767 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:44.806738 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:44.814888 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-6b0a2633-600a-4eb3-a4f3-1dd7c319a54d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.154297 May 27 03:48:44.815541 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 549/1088] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:44 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:45.831647 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:45.832392 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:45.839140 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:45.839594 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:45.840342 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:45.840774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:45.968430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:45.975994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a9cf25c0-ed17-4ab2-9821-cae537a9341a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.148251 May 27 03:48:45.976590 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 540/1089] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:45 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:46.993418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:46.993997 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:46.995922 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:46.996600 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:47.002080 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:47.002535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:47.003347 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:47.003793 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:47.135079 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:47.143283 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-aa51e8f5-8915-49f1-94f8-1c23c3f144bd tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.153996 May 27 03:48:47.143858 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 550/1090] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:46 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:48.159772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:48.161239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:48.164333 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:48.168995 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:48.169568 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:48.170168 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:48.170621 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:48.303470 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:48.310987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-071f1171-ecd6-4d8e-b46f-3af99a71cbba tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.155036 May 27 03:48:48.311562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 541/1091] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:48 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:49.327116 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:49.327730 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:49.335226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:49.335226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:49.335736 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:49.336171 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:49.461729 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:49.469796 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d5b7d006-ddb9-4e25-85ff-5d3f48356fa2 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.146649 May 27 03:48:49.470365 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 551/1092] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:49 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:50.476530 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-dfd7b905-8e50-4978-abe5-9ef4c938997b req-34fdd69c-f0ef-4124-8df1-6dd8e15292fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788423a8-d964-45c7-a881-d67ad880306b", "name": "network-vif-plugged", "status": "completed", "tag": "d0336d7e-69a4-4a30-8efc-dfa397dc0daf"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:50.485060 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-dfd7b905-8e50-4978-abe5-9ef4c938997b req-34fdd69c-f0ef-4124-8df1-6dd8e15292fc service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:50.485503 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-dfd7b905-8e50-4978-abe5-9ef4c938997b req-34fdd69c-f0ef-4124-8df1-6dd8e15292fc service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:50.487339 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:50.488165 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:50.494803 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:50.497984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:50.497984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:50.497984 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:50.498905 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-dfd7b905-8e50-4978-abe5-9ef4c938997b req-34fdd69c-f0ef-4124-8df1-6dd8e15292fc service nova] Creating event network-vif-plugged:d0336d7e-69a4-4a30-8efc-dfa397dc0daf for instance 788423a8-d964-45c7-a881-d67ad880306b on hv-cinder-82880 May 27 03:48:50.502704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-dfd7b905-8e50-4978-abe5-9ef4c938997b req-34fdd69c-f0ef-4124-8df1-6dd8e15292fc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084165 May 27 03:48:50.503568 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 542/1093] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:50.644192 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:50.651825 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d2cb335e-b355-4e15-884f-cecf69aaca5f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.169191 May 27 03:48:50.652385 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 552/1094] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:50 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:51.669938 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:51.671649 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:51.678527 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:51.679028 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:51.679782 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:51.680212 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:51.825346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:51.832923 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0465a9b9-2079-4072-a7de-c3fd8e0e02ce tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1265 microversion: 2.1 time: 0.167175 May 27 03:48:51.833480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 543/1095] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:51 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:52.849842 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:52.850451 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:52.857325 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:52.857804 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:52.858598 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:52.859058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:52.991073 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:52.998548 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-9b333f2c-e718-4ecc-9b4d-ef0b16969f67 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1452 microversion: 2.1 time: 0.152579 May 27 03:48:52.999650 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 553/1096] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:52 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:53.015627 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:53.016239 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:48:53.022674 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:53.023160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:53.023913 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:53.024348 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:53.149243 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:53.156675 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3dbcb949-253b-4e73-9d8f-1206dc1abdbb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1452 microversion: 2.1 time: 0.145605 May 27 03:48:53.157241 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 544/1097] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:48:53 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:55.472218 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788423a8-d964-45c7-a881-d67ad880306b", "tag": "d0336d7e-69a4-4a30-8efc-dfa397dc0daf"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:55.480234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:48:55.480748 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:48:55.492475 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] Creating event network-changed:d0336d7e-69a4-4a30-8efc-dfa397dc0daf for instance 788423a8-d964-45c7-a881-d67ad880306b on hv-cinder-82880 May 27 03:48:55.496151 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR oslo.messaging._drivers.impl_rabbit [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] [a11995ed-ade0-4c7d-8af8-e407a198409f] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:48:56.529408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] [a11995ed-ade0-4c7d-8af8-e407a198409f] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 58854. May 27 03:48:56.529408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-75011f42-aabc-4e11-a272-47d82f735489 req-684d460d-b7bd-4d21-9a95-82b6b937f500 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.098251 May 27 03:48:56.529408 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 554/1098] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:50:12.214710 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:50:12.215248 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Fri May 27 03:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:50:19.875511 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:50:19.876183 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Fri May 27 03:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:50:49.258124 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=20 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:50:49.258903 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=40 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:50:49.262900 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:49.263430 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:49.270204 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:49.270654 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:49.271493 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:49.271961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:49.297994 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:50:49.609736 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-091197c7-18dc-4e32-b097-32b93aaa112e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "DELETE /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 204 len: 0 microversion: 2.1 time: 0.353086 May 27 03:50:49.610237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 545/1099] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:50:49 2022] DELETE /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:50:49.616589 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [20b8accb-d49a-4293-88db-88937ab92f49] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:50:49.617062 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:50:49.617778 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=61 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:50:49.622163 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:49.622878 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:49.628904 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:49.629353 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:49.630156 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:49.630588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:49.810071 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:49.818132 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2405de39-f06f-453a-a2b4-77ec585d0f1c tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1577 microversion: 2.1 time: 0.203508 May 27 03:50:49.818697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 555/1100] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:49 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:50.836955 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:50.837710 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:50.845086 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:50.845534 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:50.846289 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:50.846708 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:51.030358 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:51.037892 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b8736e26-a039-42f4-8d80-d5f19349e2f4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1577 microversion: 2.1 time: 0.205820 May 27 03:50:51.038451 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 546/1101] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:50 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:52.055259 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:52.056015 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:52.065758 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:52.066296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:52.067692 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:52.068204 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:52.093418 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] [20b8accb-d49a-4293-88db-88937ab92f49] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 58904. May 27 03:50:52.136704 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:52.145438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-58b0bc37-a5f1-4632-850d-a26b1cd44671 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1509 microversion: 2.1 time: 0.094134 May 27 03:50:52.146103 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 556/1102] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:52 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:52.160971 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-fb70dc2a-c84b-4130-850e-326946ae7666 req-87cf7c01-18e7-4e6b-970d-958d4f68b844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788423a8-d964-45c7-a881-d67ad880306b", "name": "network-vif-deleted", "tag": "d0336d7e-69a4-4a30-8efc-dfa397dc0daf"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:52.169651 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-fb70dc2a-c84b-4130-850e-326946ae7666 req-87cf7c01-18e7-4e6b-970d-958d4f68b844 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:52.174410 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-fb70dc2a-c84b-4130-850e-326946ae7666 req-87cf7c01-18e7-4e6b-970d-958d4f68b844 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:52.184228 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-fb70dc2a-c84b-4130-850e-326946ae7666 req-87cf7c01-18e7-4e6b-970d-958d4f68b844 service nova] Creating event network-vif-deleted:d0336d7e-69a4-4a30-8efc-dfa397dc0daf for instance 788423a8-d964-45c7-a881-d67ad880306b on hv-cinder-82880 May 27 03:50:52.189888 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-fb70dc2a-c84b-4130-850e-326946ae7666 req-87cf7c01-18e7-4e6b-970d-958d4f68b844 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 May 27 03:50:52.190865 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 547/1103] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:50:53.163738 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:53.164277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:53.170848 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:53.171486 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:53.172252 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:53.172688 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:53.205753 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:53.206212 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:53.207316 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.objects.instance [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lazy-loading 'fault' on Instance uuid 788423a8-d964-45c7-a881-d67ad880306b {{(pid=124770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:50:53.249497 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:53.257029 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-c6faf217-602d-4f96-b683-bda1f98819c1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 200 len: 1229 microversion: 2.1 time: 0.097280 May 27 03:50:53.257605 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 557/1104] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:53 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:54.276084 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:54.276772 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:54.283473 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:54.283917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:54.284661 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:54.285088 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:54.299104 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] HTTP exception thrown: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Request method failure captured: May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b HTTP/1.1 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEn5gxR6xNu3UJkEoVMQdT-UWOz04ED7m8VW7DJdC7ndCWFUG-xvFrEY84CVfIn95JZ4g6LcfyafghhBcROPrP3lu6u7zEAPWESxZx-rC2pj7lL0o0PDNDjCIoZJ1llxg02bf4gBsZc1KJc4NPy93ReXcMqZeDeJ1Xt3_odv0rAFuq4 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 696d1db827244c65b179789b47baabe1 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:50:54.300684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_696d1db827244c65b179789b47baabe1", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/696d1db827244c65b179789b47baabe1"}]}] May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestVolumeBootPattern-1093174049 May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 696d1db827244c65b179789b47baabe1 May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-TestVolumeBootPattern-1093174049-project May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: a98a71f87f4b49fbb98d068065edb1f6 May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestVolumeBootPattern-1093174049-project May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:50:54.302429 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '788423a8-d964-45c7-a881-d67ad880306b'} May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:50:54.303452 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:50:54.305051 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:50:54.306522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Returning 404 to user: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:50:54.306522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dcc1bb7b-e5b7-4422-8103-f11698e7565e tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 404 len: 111 microversion: 2.1 time: 0.030556 May 27 03:50:54.306522 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 548/1105] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:54 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:50:54.346785 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1851872582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-549038653", "security_groups": [{"name": "tempest-secgroup-smoke-1707052482"}], "block_device_mapping_v2": [{"uuid": "87b02003-724b-45a2-b94c-5d5a86669bc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3032795-d107-4737-b6eb-c559a5838bdb"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:54.459430 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] validate_networks() for [('e3032795-d107-4737-b6eb-c559a5838bdb', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:50:54.810248 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:50:54.810677 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:50:54.811194 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:50:54.812162 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:50:54.812576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:50:54.821296 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:54.821747 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:54.822549 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:54.823036 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:54.839735 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for project 696d1db827244c65b179789b47baabe1. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:50:54.843710 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for user a98a71f87f4b49fbb98d068065edb1f6 and project 696d1db827244c65b179789b47baabe1. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:50:54.900559 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:50:54.902659 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87b02003-724b-45a2-b94c-5d5a86669bc0',volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:50:55.303084 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0cc226c9-0ddc-4ae4-b657-9dfecdb988c7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960553 May 27 03:50:55.303749 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 558/1106] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:50:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:50:55.313956 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-437805f6-f679-4182-8a61-015c2c0fe8b8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:55.314562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-437805f6-f679-4182-8a61-015c2c0fe8b8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:55.375178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-437805f6-f679-4182-8a61-015c2c0fe8b8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:55.381946 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-437805f6-f679-4182-8a61-015c2c0fe8b8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1094 microversion: 2.1 time: 0.071993 May 27 03:50:55.382505 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 549/1107] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:55 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:56.399337 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:56.399951 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:56.406868 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:56.407320 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:56.408137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:56.408570 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:56.472550 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:56.479933 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-85f37a23-beb8-4540-80af-d80ba50e8257 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1144 microversion: 2.1 time: 0.084520 May 27 03:50:56.480502 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 559/1108] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:56 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:57.497498 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:57.498237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:57.505696 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:57.506177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:57.506975 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:57.507462 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:57.568901 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:57.583076 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-59648c2c-c2ed-4968-95fd-d70f50b0cd23 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1200 microversion: 2.1 time: 0.089565 May 27 03:50:57.583658 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 550/1109] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:57 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:58.601577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:58.615046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:58.615046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:58.615046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:58.615046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:58.615750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:58.756943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:58.764521 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-66b44266-09d0-496e-bd01-d53376a13385 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1278 microversion: 2.1 time: 0.166808 May 27 03:50:58.765136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 560/1110] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:58 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:59.188257 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-76d16c61-d632-4c9e-a69d-5fc8c8c17edc req-a0934a5e-d386-49d7-a459-87f30a57cd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a963f3ea-f214-49ba-8fc5-7c971471b478", "tag": "8ca6625c-d7df-4b56-bf97-c6237fe12736"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:59.203106 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-76d16c61-d632-4c9e-a69d-5fc8c8c17edc req-a0934a5e-d386-49d7-a459-87f30a57cd1b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:59.203552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-76d16c61-d632-4c9e-a69d-5fc8c8c17edc req-a0934a5e-d386-49d7-a459-87f30a57cd1b service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:59.216840 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-76d16c61-d632-4c9e-a69d-5fc8c8c17edc req-a0934a5e-d386-49d7-a459-87f30a57cd1b service nova] Creating event network-changed:8ca6625c-d7df-4b56-bf97-c6237fe12736 for instance a963f3ea-f214-49ba-8fc5-7c971471b478 on hv-cinder-82880 May 27 03:50:59.228698 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-76d16c61-d632-4c9e-a69d-5fc8c8c17edc req-a0934a5e-d386-49d7-a459-87f30a57cd1b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044154 May 27 03:50:59.229319 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 551/1111] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:50:59.781470 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:59.782136 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:50:59.789406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:59.789859 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:59.790627 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:50:59.791086 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:50:59.919754 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:59.927884 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-d075e546-a8bd-454f-a793-2f28de14095a tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.150279 May 27 03:50:59.928466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 561/1112] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:50:59 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:00.946388 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:00.947107 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:00.953296 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:00.953739 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:00.954480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:00.955601 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:01.081372 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:01.089235 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ef2c8f7e-eae7-4106-b60a-2f68ba70f696 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.147684 May 27 03:51:01.089802 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 552/1113] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:00 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:02.105483 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:02.106100 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:02.112826 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:02.113277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:02.114036 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:02.114498 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:02.246185 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:02.253768 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-ae741565-affb-46c2-b183-99e44c924d0f tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.152199 May 27 03:51:02.254372 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 562/1114] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:02 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:03.270861 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:03.271492 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:03.278012 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:03.278453 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:03.279233 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:03.279663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:03.407572 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:03.415703 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e2e9e8bc-9614-46e5-b6ac-a7dab0eeb998 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.149022 May 27 03:51:03.416265 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 553/1115] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:03 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:04.432981 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:04.433523 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:04.440728 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:04.441175 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:04.441935 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:04.442371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:04.571542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:04.579025 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5dc2a73b-3484-48d1-b143-44275d06a140 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.149982 May 27 03:51:04.579595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 563/1116] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:04 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:05.595328 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:05.595969 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:05.598346 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:51:05.603313 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:05.603762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:05.604514 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:05.604950 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:05.731859 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:05.739284 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9f077509-8a49-4e14-a213-af0bcdeb84bc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.147928 May 27 03:51:05.739846 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 554/1117] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:05 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:06.756061 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:06.756675 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:06.758518 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:51:06.759206 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:51:06.764555 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:06.765010 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:06.765773 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:06.766457 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:06.893895 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:06.901466 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-0a864bbb-dbad-461e-99f5-befaf7f0d24d tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.149283 May 27 03:51:06.902030 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 564/1118] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:06 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:07.918557 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:07.919195 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:07.926295 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:07.926740 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:07.927525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:07.927987 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:08.058769 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:08.066211 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-afb97662-e223-4983-8d79-3510e8632195 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.151583 May 27 03:51:08.066765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 555/1119] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:07 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:09.083595 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:09.084212 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:09.091058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:09.091515 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:09.092293 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:09.092756 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:09.234948 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:09.243544 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a18ed856-b045-4764-b6a1-8dda12bb7ee9 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.164373 May 27 03:51:09.244122 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 565/1120] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:09 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:09.244620 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-61f55d87-779f-407c-bf62-08f224a9ec59 req-3ee165d4-d5f5-423d-96a6-dafbff7dfd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a963f3ea-f214-49ba-8fc5-7c971471b478", "name": "network-vif-plugged", "status": "completed", "tag": "8ca6625c-d7df-4b56-bf97-c6237fe12736"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:09.253831 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-61f55d87-779f-407c-bf62-08f224a9ec59 req-3ee165d4-d5f5-423d-96a6-dafbff7dfd24 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:09.254274 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-61f55d87-779f-407c-bf62-08f224a9ec59 req-3ee165d4-d5f5-423d-96a6-dafbff7dfd24 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:09.265083 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-61f55d87-779f-407c-bf62-08f224a9ec59 req-3ee165d4-d5f5-423d-96a6-dafbff7dfd24 service nova] Creating event network-vif-plugged:8ca6625c-d7df-4b56-bf97-c6237fe12736 for instance a963f3ea-f214-49ba-8fc5-7c971471b478 on hv-cinder-82880 May 27 03:51:09.271129 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-61f55d87-779f-407c-bf62-08f224a9ec59 req-3ee165d4-d5f5-423d-96a6-dafbff7dfd24 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030645 May 27 03:51:09.271715 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 556/1121] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:51:10.261429 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:10.262040 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:10.268633 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:10.269085 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:10.269842 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:10.270277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:10.402189 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:10.410172 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-a26aa72f-f562-40ef-805a-b292ebee0fd8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1266 microversion: 2.1 time: 0.152774 May 27 03:51:10.410742 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 566/1122] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:10 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:11.428707 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:11.429324 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:11.435564 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:11.436015 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:11.436768 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:11.437202 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:11.565663 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:11.573447 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2b2835f7-7489-44e7-a237-b06d4c298144 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1453 microversion: 2.1 time: 0.150186 May 27 03:51:11.574069 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 557/1123] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:11 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:11.600442 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:11.601069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:51:11.607603 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:11.608060 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:11.608853 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:11.609295 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:11.739371 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:11.747168 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-4fed920d-ab1d-454c-9e99-ed7131785b3b tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1453 microversion: 2.1 time: 0.150495 May 27 03:51:11.748288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 567/1124] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:51:11 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:13.731349 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-095cf4d2-67b3-4576-b9f3-d37f4034b128 req-cb21e309-2561-4ed6-8a41-b1ced41d6adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a963f3ea-f214-49ba-8fc5-7c971471b478", "tag": "8ca6625c-d7df-4b56-bf97-c6237fe12736"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:13.740416 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-095cf4d2-67b3-4576-b9f3-d37f4034b128 req-cb21e309-2561-4ed6-8a41-b1ced41d6adc service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:51:13.740859 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-095cf4d2-67b3-4576-b9f3-d37f4034b128 req-cb21e309-2561-4ed6-8a41-b1ced41d6adc service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:51:13.751954 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-095cf4d2-67b3-4576-b9f3-d37f4034b128 req-cb21e309-2561-4ed6-8a41-b1ced41d6adc service nova] Creating event network-changed:8ca6625c-d7df-4b56-bf97-c6237fe12736 for instance a963f3ea-f214-49ba-8fc5-7c971471b478 on hv-cinder-82880 May 27 03:51:13.757115 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-095cf4d2-67b3-4576-b9f3-d37f4034b128 req-cb21e309-2561-4ed6-8a41-b1ced41d6adc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029442 May 27 03:51:13.757815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 558/1125] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:58.487293 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:51:58.487844 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:52:48.405799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:48.406542 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=76 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:48.410550 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-418419147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-549038653", "security_groups": [{"name": "tempest-secgroup-smoke-1707052482"}], "block_device_mapping_v2": [{"uuid": "349209b3-eb1d-471a-a1a2-652c030a52e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3032795-d107-4737-b6eb-c559a5838bdb"}]}} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:52:48.520048 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.network.neutron [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] validate_networks() for [('e3032795-d107-4737-b6eb-c559a5838bdb', None, None, None, None, None)] {{(pid=124770) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:52:48.877386 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Flavor limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:52:48.877828 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Image limits 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:52:48.878304 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Flavor pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:52:48.878715 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Image pref 0:0:0 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:52:48.879169 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.virt.hardware [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:52:48.888129 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:48.888584 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:48.889385 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:48.889827 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:48.906223 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for project 696d1db827244c65b179789b47baabe1. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:52:48.910046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.quota [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Getting quotas for user a98a71f87f4b49fbb98d068065edb1f6 and project 696d1db827244c65b179789b47baabe1. Resources: {'instances', 'cores', 'ram'} {{(pid=124770) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:52:48.978506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Going to run 1 instances... {{(pid=124770) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:52:48.978506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='349209b3-eb1d-471a-a1a2-652c030a52e4',volume_size=None,volume_type=None)] {{(pid=124770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:52:49.413389 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-10005634-4fc6-4c92-981c-4f5b56907507 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.009186 May 27 03:52:49.418943 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 568/1126] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 27 03:52:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:52:49.423299 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:49.424143 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:49.428552 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f76f7ca3-c272-482d-b0a9-fdb1a57afc58 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:49.429278 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f76f7ca3-c272-482d-b0a9-fdb1a57afc58 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:49.496082 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f76f7ca3-c272-482d-b0a9-fdb1a57afc58 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:49.496229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f76f7ca3-c272-482d-b0a9-fdb1a57afc58 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1093 microversion: 2.1 time: 0.075349 May 27 03:52:49.496786 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 559/1127] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:49 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:52:50.514733 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:50.515306 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:50.522143 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:50.522588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:50.523370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:50.523799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:50.584227 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:50.592737 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-52b6b8f0-44e9-4d51-baf5-aa8c51e72970 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1143 microversion: 2.1 time: 0.083006 May 27 03:52:50.593298 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 569/1128] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:50 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:51.617612 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:51.618246 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:51.628979 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:51.634191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:51.634191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:51.634191 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:51.692371 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:51.700061 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6d4a134d-82a7-4966-9746-b6dbb0d189f3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1199 microversion: 2.1 time: 0.087412 May 27 03:52:51.700647 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 560/1129] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:51 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:52.719529 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:52.720139 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:52.726789 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:52.727275 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:52.728066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:52.728501 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:52.880726 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:52.890582 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-64540bb7-9144-4660-814e-68d34e605332 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1277 microversion: 2.1 time: 0.175779 May 27 03:52:52.891179 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 570/1130] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:52 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:53.716705 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-86653fbc-9e1e-4d4f-a0a7-487229e343e6 req-615632b9-bdc4-4174-8e0c-c49608e5eab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3fcc1f-a697-4dfd-b6a7-416019ccb578", "tag": "e3ba361d-51d7-4644-89d5-9f76b8dd3b33"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:52:53.726389 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-86653fbc-9e1e-4d4f-a0a7-487229e343e6 req-615632b9-bdc4-4174-8e0c-c49608e5eab1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:53.726808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-86653fbc-9e1e-4d4f-a0a7-487229e343e6 req-615632b9-bdc4-4174-8e0c-c49608e5eab1 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:53.740547 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-86653fbc-9e1e-4d4f-a0a7-487229e343e6 req-615632b9-bdc4-4174-8e0c-c49608e5eab1 service nova] Creating event network-changed:e3ba361d-51d7-4644-89d5-9f76b8dd3b33 for instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 on hv-cinder-82880 May 27 03:52:53.745599 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-86653fbc-9e1e-4d4f-a0a7-487229e343e6 req-615632b9-bdc4-4174-8e0c-c49608e5eab1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094431 May 27 03:52:53.746203 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 561/1131] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:52:53.908348 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:53.908881 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:53.923427 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:53.923914 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:53.924696 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:53.925319 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:54.057271 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:54.065698 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-7dc19ff3-f121-4a91-a43f-a0b49d36d3cb tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.161414 May 27 03:52:54.066277 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 571/1132] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:53 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:55.084562 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:55.085526 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:55.092356 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:55.092815 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:55.093574 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:55.094016 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:55.219480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:55.226942 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c5831a8e-765b-4a50-8cb3-f5686a53b7c6 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.147021 May 27 03:52:55.227509 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 562/1133] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:55 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:56.244310 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:56.245648 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:56.252243 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:56.252687 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:56.253438 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:56.253870 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:56.385921 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:56.393799 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-535b4bd0-4974-4682-9f4e-2af994c37d68 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.153311 May 27 03:52:56.394369 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 572/1134] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:56 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:57.410415 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:57.411062 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:57.417628 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:57.418076 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:57.418830 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:57.419288 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:57.543793 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:57.551237 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7518ae90-514e-466c-9be5-97df9caefbd3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.144514 May 27 03:52:57.554586 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 563/1135] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:57 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:58.568588 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:58.569226 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:58.576245 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:58.576695 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:58.577450 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:58.577883 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:58.706770 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:58.715083 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-db05e4f7-39b7-4ac4-b9d2-8c77f56d1abc tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.149804 May 27 03:52:58.715651 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 573/1136] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:58 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:52:59.732553 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:59.733277 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:52:59.735694 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:59.740762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:59.747054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:59.747054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:52:59.747054 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:52:59.880659 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:59.895161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-46d46477-749f-41cb-b844-16fd1de492da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.166771 May 27 03:52:59.895758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 564/1137] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:52:59 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:00.912514 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:00.913118 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:53:00.914947 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=2 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:00.915612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell0:SELECT=6 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:00.920923 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:00.924673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:00.924673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:00.924673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:01.049802 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:01.057236 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b9c9dc2c-bf67-4d49-98fa-29f50096f0e3 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.148542 May 27 03:53:01.058288 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 574/1138] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:53:00 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:02.074090 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:02.074828 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:53:02.081717 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:02.082173 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:02.082966 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:02.083407 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:02.217896 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:02.225571 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4aacb1bd-3887-4451-b110-9e7ebe040082 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.155469 May 27 03:53:02.226146 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 565/1139] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:53:02 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:03.251968 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:03.252509 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:53:03.259026 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:03.259477 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:03.260230 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:03.260664 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:03.386615 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:03.394069 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b0296d9c-8e30-4ef9-88e1-b0c61e2d3157 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.146044 May 27 03:53:03.394622 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 575/1140] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:53:03 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:03.833495 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-65d34eff-a311-4f58-85d2-8d3b2eb34478 req-d65a2421-4091-4147-a6fc-6bef5a89678c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3fcc1f-a697-4dfd-b6a7-416019ccb578", "name": "network-vif-plugged", "status": "completed", "tag": "e3ba361d-51d7-4644-89d5-9f76b8dd3b33"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:03.843531 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-65d34eff-a311-4f58-85d2-8d3b2eb34478 req-d65a2421-4091-4147-a6fc-6bef5a89678c service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:03.843970 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-65d34eff-a311-4f58-85d2-8d3b2eb34478 req-d65a2421-4091-4147-a6fc-6bef5a89678c service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:03.854645 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-65d34eff-a311-4f58-85d2-8d3b2eb34478 req-d65a2421-4091-4147-a6fc-6bef5a89678c service nova] Creating event network-vif-plugged:e3ba361d-51d7-4644-89d5-9f76b8dd3b33 for instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 on hv-cinder-82880 May 27 03:53:03.859841 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-65d34eff-a311-4f58-85d2-8d3b2eb34478 req-d65a2421-4091-4147-a6fc-6bef5a89678c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 May 27 03:53:03.865042 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 566/1141] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:04.411262 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:04.411902 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:53:04.419038 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:04.419489 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:04.420239 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:04.420669 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:04.804899 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:04.812322 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-101bea3f-3679-4b00-a58d-5571d757aa94 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1265 microversion: 2.1 time: 0.404971 May 27 03:53:04.812886 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 576/1142] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:53:04 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:05.831027 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:05.831727 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:53:05.838312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:05.838762 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:05.839551 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:05.839985 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:05.969386 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:05.976890 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9af65641-e475-4b18-9e46-5d0c3fef7712 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1452 microversion: 2.1 time: 0.150731 May 27 03:53:05.977456 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 567/1143] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:53:05 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:05.993750 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:05.994357 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:53:06.001506 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:06.002009 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:06.002907 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:06.003342 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:06.131176 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:06.138741 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-82d0ab4d-6997-47f5-a485-dd4f9d502ae5 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1452 microversion: 2.1 time: 0.148844 May 27 03:53:06.139366 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 577/1144] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:53:05 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:08.131178 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-f88dcf3c-432e-43dc-84bb-e81253b5f69d req-3643d5d9-d3e3-47da-b35a-1196adb146f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3fcc1f-a697-4dfd-b6a7-416019ccb578", "tag": "e3ba361d-51d7-4644-89d5-9f76b8dd3b33"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:08.139523 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-f88dcf3c-432e-43dc-84bb-e81253b5f69d req-3643d5d9-d3e3-47da-b35a-1196adb146f7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:53:08.139961 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-f88dcf3c-432e-43dc-84bb-e81253b5f69d req-3643d5d9-d3e3-47da-b35a-1196adb146f7 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:53:08.151364 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-f88dcf3c-432e-43dc-84bb-e81253b5f69d req-3643d5d9-d3e3-47da-b35a-1196adb146f7 service nova] Creating event network-changed:e3ba361d-51d7-4644-89d5-9f76b8dd3b33 for instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 on hv-cinder-82880 May 27 03:53:08.156848 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-f88dcf3c-432e-43dc-84bb-e81253b5f69d req-3643d5d9-d3e3-47da-b35a-1196adb146f7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029173 May 27 03:53:08.157813 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 568/1145] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:32.223059 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:53:32.223804 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Fri May 27 03:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:53:39.883505 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:53:39.884229 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Fri May 27 03:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:54:01.802098 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:54:01.802718 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:54:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:54:36.181409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:36.181409 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:36.182851 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=22 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:36.183568 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:36.184245 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=42 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:36.184376 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG dbcounter [-] [124770] Writing DB stats nova_cell1:SELECT=56 {{(pid=124770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:36.188046 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:36.188569 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:36.189453 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:36.189967 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:36.216370 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Going to try to terminate instance {{(pid=124770) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:54:36.238992 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-3e34317a-681e-46d7-a153-544ed4aa15dd req-fcadc1b4-8834-4bdb-88c3-61fae37f33aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3fcc1f-a697-4dfd-b6a7-416019ccb578", "tag": "e3ba361d-51d7-4644-89d5-9f76b8dd3b33"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:54:36.248579 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-3e34317a-681e-46d7-a153-544ed4aa15dd req-fcadc1b4-8834-4bdb-88c3-61fae37f33aa service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:36.249031 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-3e34317a-681e-46d7-a153-544ed4aa15dd req-fcadc1b4-8834-4bdb-88c3-61fae37f33aa service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:36.260345 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-3e34317a-681e-46d7-a153-544ed4aa15dd req-fcadc1b4-8834-4bdb-88c3-61fae37f33aa service nova] Creating event network-changed:e3ba361d-51d7-4644-89d5-9f76b8dd3b33 for instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 on hv-cinder-82880 May 27 03:54:36.265758 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-3e34317a-681e-46d7-a153-544ed4aa15dd req-fcadc1b4-8834-4bdb-88c3-61fae37f33aa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088567 May 27 03:54:36.268943 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 569/1146] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:54:36.567095 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-5baecff7-40f7-4a6d-9f2c-5f332cf8e357 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 204 len: 0 microversion: 2.1 time: 0.392080 May 27 03:54:36.567697 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 578/1147] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:54:36 2022] DELETE /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:54:36.576774 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:36.577578 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:36.585078 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:36.586041 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:36.586480 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:36.586934 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:36.728236 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:36.737520 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-13dcce6b-4b1d-487e-81b2-4d80626e37cf tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1576 microversion: 2.1 time: 0.165362 May 27 03:54:36.738110 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 570/1148] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:36 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:54:37.756278 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:37.756986 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:37.764102 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:37.764586 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:37.765364 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:37.765776 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:37.898866 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:37.906631 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-3daf9c4a-3140-4175-a2a7-0224053aab26 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1576 microversion: 2.1 time: 0.154685 May 27 03:54:37.912300 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 579/1149] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:37 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:38.809332 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-06086c6e-aa10-41ef-8383-65675464698a req-58fe9895-3337-41ed-a5db-989650b1cea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3fcc1f-a697-4dfd-b6a7-416019ccb578", "name": "network-vif-deleted", "tag": "e3ba361d-51d7-4644-89d5-9f76b8dd3b33"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:54:38.817760 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-06086c6e-aa10-41ef-8383-65675464698a req-58fe9895-3337-41ed-a5db-989650b1cea2 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:38.823297 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-06086c6e-aa10-41ef-8383-65675464698a req-58fe9895-3337-41ed-a5db-989650b1cea2 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:38.829513 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-06086c6e-aa10-41ef-8383-65675464698a req-58fe9895-3337-41ed-a5db-989650b1cea2 service nova] Creating event network-vif-deleted:e3ba361d-51d7-4644-89d5-9f76b8dd3b33 for instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 on hv-cinder-82880 May 27 03:54:38.834244 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-06086c6e-aa10-41ef-8383-65675464698a req-58fe9895-3337-41ed-a5db-989650b1cea2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028594 May 27 03:54:38.835185 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 571/1150] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:54:38.923971 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:38.924673 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:38.931267 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:38.931719 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:38.932535 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:38.932975 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:38.993679 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:39.001572 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-170ea263-c86b-477b-8852-3c733ae509ab tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1224 microversion: 2.1 time: 0.081516 May 27 03:54:39.002137 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 580/1151] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:38 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:40.020312 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:40.021003 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:40.027164 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:40.031458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:40.031458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:40.031458 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:40.060161 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:40.060630 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:40.061073 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lazy-loading 'fault' on Instance uuid ef3fcc1f-a697-4dfd-b6a7-416019ccb578 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:54:40.105518 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:40.112986 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ccfd164d-cc21-4326-bf4b-cdd0b27cd0da tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 200 len: 1229 microversion: 2.1 time: 0.097983 May 27 03:54:40.117614 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 572/1152] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:40 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:41.130183 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:41.130806 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: ef3fcc1f-a697-4dfd-b6a7-416019ccb578] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:41.137634 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:41.138088 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:41.138862 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:41.139306 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:41.153234 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] HTTP exception thrown: Instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 could not be found. May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Request method failure captured: May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 HTTP/1.1 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEn5gxR6xNu3UJkEoVMQdT-UWOz04ED7m8VW7DJdC7ndCWFUG-xvFrEY84CVfIn95JZ4g6LcfyafghhBcROPrP3lu6u7zEAPWESxZx-rC2pj7lL0o0PDNDjCIoZJ1llxg02bf4gBsZc1KJc4NPy93ReXcMqZeDeJ1Xt3_odv0rAFuq4 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:54:41.154772 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_696d1db827244c65b179789b47baabe1", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/696d1db827244c65b179789b47baabe1"}]}] May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: a98a71f87f4b49fbb98d068065edb1f6 May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 could not be found. May 27 03:54:41.156530 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'ef3fcc1f-a697-4dfd-b6a7-416019ccb578'} May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 could not be found. May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:54:41.158131 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 could not be found. May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 could not be found. May 27 03:54:41.159809 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:41.161395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Returning 404 to user: Instance ef3fcc1f-a697-4dfd-b6a7-416019ccb578 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:54:41.161395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-45978650-7f24-422c-8457-9d27237fcc47 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578" status: 404 len: 111 microversion: 2.1 time: 0.030016 May 27 03:54:41.161395 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 581/1153] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:41 2022] GET /compute/v2.1/servers/ef3fcc1f-a697-4dfd-b6a7-416019ccb578 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:54:44.448969 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:44.449704 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:44.451551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-558e5a14-eeea-47ff-adc5-8ca70803122f req-3de69717-0074-4dee-a277-44700031e8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a963f3ea-f214-49ba-8fc5-7c971471b478", "tag": "8ca6625c-d7df-4b56-bf97-c6237fe12736"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:54:44.457188 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:44.457642 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:44.458796 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:44.459269 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:44.461365 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-558e5a14-eeea-47ff-adc5-8ca70803122f req-3de69717-0074-4dee-a277-44700031e8e0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:44.462233 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-558e5a14-eeea-47ff-adc5-8ca70803122f req-3de69717-0074-4dee-a277-44700031e8e0 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:44.473869 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-558e5a14-eeea-47ff-adc5-8ca70803122f req-3de69717-0074-4dee-a277-44700031e8e0 service nova] Creating event network-changed:8ca6625c-d7df-4b56-bf97-c6237fe12736 for instance a963f3ea-f214-49ba-8fc5-7c971471b478 on hv-cinder-82880 May 27 03:54:44.479434 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-558e5a14-eeea-47ff-adc5-8ca70803122f req-3de69717-0074-4dee-a277-44700031e8e0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032293 May 27 03:54:44.480670 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 582/1154] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:54:44.487117 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:54:44.844148 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-04f4723b-7890-4821-99c0-a5245b358743 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 204 len: 0 microversion: 2.1 time: 0.398945 May 27 03:54:44.845026 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 573/1155] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:54:44 2022] DELETE /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:54:44.860686 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:44.862426 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:44.872123 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:44.876628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:44.876628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:44.876628 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:45.010240 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.policy [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124770) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:45.017833 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-f0d2df8b-c5c7-45f0-a6b2-146a5fa27c55 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1577 microversion: 2.1 time: 0.165938 May 27 03:54:45.018389 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 583/1156] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:44 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:46.035544 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:46.036287 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:46.042713 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:46.043192 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:46.043952 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:46.044383 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:46.174830 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:46.182330 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-85110a0d-3454-4b58-a70c-1279d6365fe7 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1577 microversion: 2.1 time: 0.151120 May 27 03:54:46.182917 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 574/1157] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:46 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:47.189115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [req-d2612b1e-c48f-446a-89fc-0d46c236edbf req-6c5c9616-ade2-46e3-ae17-19f668bb3762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a963f3ea-f214-49ba-8fc5-7c971471b478", "name": "network-vif-deleted", "tag": "8ca6625c-d7df-4b56-bf97-c6237fe12736"}]} {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:54:47.198202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d2612b1e-c48f-446a-89fc-0d46c236edbf req-6c5c9616-ade2-46e3-ae17-19f668bb3762 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:47.198647 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [req-d2612b1e-c48f-446a-89fc-0d46c236edbf req-6c5c9616-ade2-46e3-ae17-19f668bb3762 service nova] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:47.200208 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:47.200684 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:47.208315 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:47.208765 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:47.209779 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:47.210213 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:47.210608 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.compute.server_external_events [req-d2612b1e-c48f-446a-89fc-0d46c236edbf req-6c5c9616-ade2-46e3-ae17-19f668bb3762 service nova] Creating event network-vif-deleted:8ca6625c-d7df-4b56-bf97-c6237fe12736 for instance a963f3ea-f214-49ba-8fc5-7c971471b478 on hv-cinder-82880 May 27 03:54:47.215653 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [req-d2612b1e-c48f-446a-89fc-0d46c236edbf req-6c5c9616-ade2-46e3-ae17-19f668bb3762 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030204 May 27 03:54:47.216247 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 584/1158] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 27 03:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:54:47.539573 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98a71f87f4b49fbb98d068065edb1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d1db827244c65b179789b47baabe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:47.547366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0ca81e01-6e05-4e74-b7f8-af4c253ee8f1 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 200 len: 1391 microversion: 2.1 time: 0.351107 May 27 03:54:47.548177 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 575/1159] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:47 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:48.566707 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:48.567449 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: a963f3ea-f214-49ba-8fc5-7c971471b478] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:48.573777 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:48.574237 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:48.575036 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:48.575478 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:48.588872 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] HTTP exception thrown: Instance a963f3ea-f214-49ba-8fc5-7c971471b478 could not be found. May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Request method failure captured: May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 HTTP/1.1 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEn5gxR6xNu3UJkEoVMQdT-UWOz04ED7m8VW7DJdC7ndCWFUG-xvFrEY84CVfIn95JZ4g6LcfyafghhBcROPrP3lu6u7zEAPWESxZx-rC2pj7lL0o0PDNDjCIoZJ1llxg02bf4gBsZc1KJc4NPy93ReXcMqZeDeJ1Xt3_odv0rAFuq4 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:54:48.590520 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_696d1db827244c65b179789b47baabe1", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/696d1db827244c65b179789b47baabe1"}]}] May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: a98a71f87f4b49fbb98d068065edb1f6 May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance a963f3ea-f214-49ba-8fc5-7c971471b478 could not be found. May 27 03:54:48.592053 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': 'a963f3ea-f214-49ba-8fc5-7c971471b478'} May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a963f3ea-f214-49ba-8fc5-7c971471b478 could not be found. May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:54:48.592873 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a963f3ea-f214-49ba-8fc5-7c971471b478 could not be found. May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a963f3ea-f214-49ba-8fc5-7c971471b478 could not be found. May 27 03:54:48.594202 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:48.595468 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Returning 404 to user: Instance a963f3ea-f214-49ba-8fc5-7c971471b478 could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:54:48.595468 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-b3ec18ce-cd46-4631-9a42-7fcfdf2b02ca tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478" status: 404 len: 111 microversion: 2.1 time: 0.031079 May 27 03:54:48.595468 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 585/1160] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:48 2022] GET /compute/v2.1/servers/a963f3ea-f214-49ba-8fc5-7c971471b478 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:54:49.083391 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:49.083897 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:49.090646 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:49.091131 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:49.091889 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:49.092321 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:49.106151 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] HTTP exception thrown: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Request method failure captured: May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b HTTP/1.1 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept: application/json May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Connection: close May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Length: 0 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Content-Type: application/json May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Host: 10.222.0.24 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.9 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABikEn5gxR6xNu3UJkEoVMQdT-UWOz04ED7m8VW7DJdC7ndCWFUG-xvFrEY84CVfIn95JZ4g6LcfyafghhBcROPrP3lu6u7zEAPWESxZx-rC2pj7lL0o0PDNDjCIoZJ1llxg02bf4gBsZc1KJc4NPy93ReXcMqZeDeJ1Xt3_odv0rAFuq4 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Id: None May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Domain-Name: None May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Role: member,reader May 27 03:54:49.107812 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Roles: member,reader May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_696d1db827244c65b179789b47baabe1", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/696d1db827244c65b179789b47baabe1"}]}] May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Id: a98a71f87f4b49fbb98d068065edb1f6 May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: method: > May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: exception: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.109525 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: action_args: {'id': '788423a8-d964-45c7-a881-d67ad880306b'} May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:54:49.110702 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.112366 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi May 27 03:54:49.113978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Returning 404 to user: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:54:49.113978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-664cc407-b6c5-4d44-bbce-1fc6c924ae21 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "DELETE /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 404 len: 111 microversion: 2.1 time: 0.029740 May 27 03:54:49.113978 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 576/1161] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 27 03:54:49 2022] DELETE /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:54:49.117936 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '>' {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:49.118551 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.compute.api [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] [instance: 788423a8-d964-45c7-a881-d67ad880306b] Fetching instance by UUID {{(pid=124770) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:54:49.124576 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:49.125058 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:49.125833 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:54:49.126266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG oslo_concurrency.lockutils [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Lock "2e92bf5b-a7a5-461c-810d-6697c81d065e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:54:49.139612 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.wsgi [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] HTTP exception thrown: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Request method failure captured: May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: request: GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b HTTP/1.1 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept: application/json May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Accept-Encoding: identity May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Connection: close May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Length: 0 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Content-Type: application/json May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Host: 10.222.0.24 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Openstack-System-Scope: None May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: User-Agent: python-urllib3/1.26.9 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Auth-Token: gAAAAABikEn5gxR6xNu3UJkEoVMQdT-UWOz04ED7m8VW7DJdC7ndCWFUG-xvFrEY84CVfIn95JZ4g6LcfyafghhBcROPrP3lu6u7zEAPWESxZx-rC2pj7lL0o0PDNDjCIoZJ1llxg02bf4gBsZc1KJc4NPy93ReXcMqZeDeJ1Xt3_odv0rAFuq4 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Id: None May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Domain-Name: None May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Identity-Status: Confirmed May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Is-Admin-Project: True May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Id: default May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Domain-Name: Default May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Project-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Role: member,reader May 27 03:54:49.141066 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Roles: member,reader May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_696d1db827244c65b179789b47baabe1", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/696d1db827244c65b179789b47baabe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/696d1db827244c65b179789b47baabe1"}]}] May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Id: 696d1db827244c65b179789b47baabe1 May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093174049 May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Id: default May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Domain-Name: Default May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Id: a98a71f87f4b49fbb98d068065edb1f6 May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: X-User-Name: tempest-TestVolumeBootPattern-1093174049-project May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: method: > May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: exception: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.143289 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: action_args: {'id': '788423a8-d964-45c7-a881-d67ad880306b'} May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: {{(pid=124770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:54:49.144115 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. May 27 03:54:49.145406 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: ERROR nova.api.openstack.wsgi May 27 03:54:49.146562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: DEBUG nova.api.openstack.wsgi [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Returning 404 to user: Instance 788423a8-d964-45c7-a881-d67ad880306b could not be found. {{(pid=124770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:54:49.146562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO nova.api.openstack.requestlog [None req-2a555d9c-b34d-474c-88a2-d828e24b36c4 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b" status: 404 len: 111 microversion: 2.1 time: 0.028389 May 27 03:54:49.146562 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: [pid: 124770|app: 0|req: 586/1162] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 27 03:54:49 2022] GET /compute/v2.1/servers/788423a8-d964-45c7-a881-d67ad880306b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:54:50.628193 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3bb8d691-c457-464f-a111-eec7192518f8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] Calling method '.version_select at 0x7f30468ac820>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:50.712808 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3bb8d691-c457-464f-a111-eec7192518f8 tempest-TestVolumeBootPattern-1093174049 tempest-TestVolumeBootPattern-1093174049-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-549038653" status: 202 len: 0 microversion: 2.1 time: 0.088466 May 27 03:54:50.713420 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 577/1163] 10.222.0.24 () {58 vars in 1259 bytes} [Fri May 27 03:54:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-549038653 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:55:18.495798 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:55:18.496331 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:56:52.231607 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:56:52.232160 dv-cinder-828805-4-iscsi devstack@n-api.service[124771]: Fri May 27 03:56:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:57:21.810428 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:57:21.811034 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:57:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:58:38.504444 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:58:38.505111 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:58:46.504577 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:58:46.505266 dv-cinder-828805-4-iscsi devstack@n-api.service[124770]: Fri May 27 03:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!